-- Logs begin at Mon 2022-06-20 14:09:37 UTC, end at Mon 2022-06-20 15:12:19 UTC. -- Jun 20 14:38:07.478923 dv-cinder-836973-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 20 14:38:07.488424 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 14:38:07 2022] *** Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: nodename: dv-cinder-836973-5-iscsi Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: machine: x86_64 Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: clock source: unix Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: pcre jit disabled Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: detected number of CPU cores: 4 Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: current working directory: / Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: detected binary path: /usr/bin/uwsgi-core Jun 20 14:38:07.491292 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: your processes number limit is 47680 Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: your memory page size is 4096 bytes Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: detected max file descriptor number: 2048 Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: lock engine: pthread robust mutexes Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: thunder lock: enabled Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 20 14:38:07.491939 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 14:38:07.537493 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: Python main interpreter initialized at 0x556217a589c0 Jun 20 14:38:07.537493 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: python threads support enabled Jun 20 14:38:07.537493 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: your server socket listen backlog is limited to 100 connections Jun 20 14:38:07.537493 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: your mercy for graceful operations on workers is 90 seconds Jun 20 14:38:07.537838 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 14:38:07.537917 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: *** Operational MODE: preforking *** Jun 20 14:38:07.538159 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: *** uWSGI is running in multiple interpreter mode *** Jun 20 14:38:07.538159 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: spawned uWSGI master process (pid: 86677) Jun 20 14:38:07.538354 dv-cinder-836973-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 20 14:38:07.544741 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: spawned uWSGI worker 1 (pid: 86686, cores: 1) Jun 20 14:38:07.544741 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: spawned uWSGI worker 2 (pid: 86687, cores: 1) Jun 20 14:38:07.544741 dv-cinder-836973-5-iscsi devstack@keystone.service[86677]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 14:38:12.904887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:38:12.904887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: from cryptography.utils import int_from_bytes Jun 20 14:38:12.905711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:38:12.905711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: from cryptography.utils import int_from_bytes Jun 20 14:38:12.905821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:38:12.905821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: from cryptography.utils import int_from_bytes Jun 20 14:38:12.905821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 14:38:12.905821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: from cryptography.utils import int_from_bytes Jun 20 14:38:12.954250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:38:12.954443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 14:38:12.954520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:38:12.954592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 14:38:12.954658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] command line args: [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:38:12.954720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] command line args: [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 14:38:12.954875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:38:12.954961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 14:38:12.955025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ================================================================================ {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:38:12.955083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ================================================================================ {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 14:38:12.955292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] admin_token = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] admin_token = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] config_dir = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] config_dir = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.955939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] config_source = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] config_source = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] debug = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] debug = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.956943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_config_append = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_config_append = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_dir = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.957991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_dir = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_file = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_file = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.958885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.959961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.960985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.961978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] publish_errors = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] publish_errors = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.962998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] standard_threads = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] standard_threads = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.963974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] use_journal = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] use_journal = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] use_json = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] use_json = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] use_stderr = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] use_stderr = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964844 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] use_syslog = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.964968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] use_syslog = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.965045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.965160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 14:38:12.965233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.965957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.966899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.967875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.968941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.969983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.970952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.971865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.972960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.973984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.974909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.975986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.976061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.976211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.976291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.976440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.976545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.977952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.978889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.979922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.980960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.981973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.982917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.983955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.984967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.985975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986669 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.986907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.987938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.988993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.external = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.989799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.external = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.password = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] auth.token = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.990926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.password = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] auth.token = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.991936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.992902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.993991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.994953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.995956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.996964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.997983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.998923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:12.999993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.000982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.001927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.002916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.003892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.004918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.005990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.006905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.007978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.008944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.009900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.010988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.011966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.012941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.013889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.014982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.015967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.016885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.017849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.018940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.019983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.020798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.021935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] role.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.022887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.024684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] role.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.025529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.025639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] role.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] role.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.026916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.027906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.028933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.029981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.030889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.031981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.032935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.033875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.034964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.connection = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.035966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.connection = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.036952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.037925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.038930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.039723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:38:13.039797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.040014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.040244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 14:38:13.040413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 14:38:13.070484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.070716 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.070885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.070978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.071082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.071315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.079508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.079896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.106927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.107108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.107253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.107354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.250169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.250398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.298296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.298473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.298643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.298729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.361624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.361787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.361913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.362706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.387434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.387713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.387883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.387883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.388946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.399766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.400033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.412428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.412676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.412845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.412933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.413864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.414098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 20 14:38:13.431209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.431418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 14:38:13.431538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.431755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.431900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 14:38:13.431979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 14:38:13.432042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.432182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.432264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 20 14:38:13.432466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.432590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.432693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.432795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.433005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.433129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.433225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.444905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.445135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.445259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.453398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.453524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.456665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.456813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.457014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.457895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.458839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.459003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.459097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.459284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.459425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.485947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.486081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.487558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.487685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.487841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.487925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.493122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.493248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.493518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.493664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.493802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.493924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.501317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.501543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.501667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.501810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.506063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.506350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.506474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.506615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.506720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.506863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.506942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.507957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.508037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.508214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.526797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.527074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.527200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.527345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.531753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.531964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.535386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.535514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.535776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.535923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.540744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.540973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.544321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.544556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.548134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.548932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.549157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.549285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.549414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.549508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.549718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.568661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.568972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.569211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.569337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.569540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.569669 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.569806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.570028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.577361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.577971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.579046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.579330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.579679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.579970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.582498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.582781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.583056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.583338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.583464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.583607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.583700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.583872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.584177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.584461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.596965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.597261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.597553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.597692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.597834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.597968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.598216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.598495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.599372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.599661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.599941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.600079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.600352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.600638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.617723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.618466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.620997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.621771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.624331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.625249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.626055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.626985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.627678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.627954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.628233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.628614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.628922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.629203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.635539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.636456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.637158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.638094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.640421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.640735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.641120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.641382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.641509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.641668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.642043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.642320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.650391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.650675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.650953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.651398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.651683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.651975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.658798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.659079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.659352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.659617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.659833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 20 14:38:13.659960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.660982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.661849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.662872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.663137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.663411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 20 14:38:13.700054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556217a589c0 pid: 86687 (default app) Jun 20 14:38:13.701147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556217a589c0 pid: 86686 (default app) Jun 20 14:38:13.703595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61a91-667d-4ea3-b45a-a2cd0ffc4eb3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:13.703884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61a91-667d-4ea3-b45a-a2cd0ffc4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:13.704167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61a91-667d-4ea3-b45a-a2cd0ffc4eb3 None None] PATH_INFO: `/v3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:13.708413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Mon Jun 20 14:38:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:21.271972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:21.272571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:21.272571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:21.277021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:21.283512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:21.284328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:21.284444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:21.358406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: INFO dbcounter [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] Registered counter for database keystone Jun 20 14:38:21.383329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG oslo_db.sqlalchemy.engines [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:38:21.394215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writer thread running {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:38:21.579003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG passlib.handlers.bcrypt [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86687) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 14:38:21.579325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG passlib.handlers.bcrypt [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86687) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 14:38:21.634581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:21.636200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:21.778837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 20 14:38:21.832784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:21.914401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: INFO dbcounter [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] Registered counter for database keystone Jun 20 14:38:21.936099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG oslo_db.sqlalchemy.engines [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 14:38:21.944707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writer thread running {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 14:38:22.069097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed16b9f-2819-47ed-9d64-9dbdb37505d8 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:22.074356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:22.075028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:22.075314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:22.075590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:22.084916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:22.137061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 14:38:22.137408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fcd6b-30fb-4f66-a49f-7b9bdbb1e781 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:22.151161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Jun 20 14:38:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:38:22.157967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:22.172971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e1fe6-6fde-46a6-bdd4-578682508b54 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:22.178247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:22.179387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:22.179680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:22.179953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] PATH_INFO: `/v3/projects/995754b005f44c748381f029d2a25afd` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:22.184176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] RBAC: Authorizing `identity:get_project(project_id=995754b005f44c748381f029d2a25afd)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:22.235377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 20 14:38:22.235727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabde2ce-5e14-4085-ade2-1af405c70f35 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:22.240417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Mon Jun 20 14:38:22 2022] GET /identity/v3/projects/995754b005f44c748381f029d2a25afd => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:24.240232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f131-24dc-497f-ae3d-ace1094d082d None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:24.240778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f131-24dc-497f-ae3d-ace1094d082d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:24.240864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f131-24dc-497f-ae3d-ace1094d082d None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:24.247562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:24.256182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:24.256635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:24.256751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:24.277595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:24.279052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:24.287599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 20 14:38:24.310246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f131-24dc-497f-ae3d-ace1094d082d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:24.324933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f131-24dc-497f-ae3d-ace1094d082d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:24.330079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:24.330720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:24.331003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:24.331279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:24.339542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:24.341380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320d4d5-e9bf-41d0-8a5e-3d889a8dbcff admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:24.350475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Mon Jun 20 14:38:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:38:24.359084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:24.369147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b0e45-4d6e-4b8b-994e-8fa9c7df2742 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:24.374826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:24.375713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:24.375993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:24.376269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:24.377899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:24.379774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492744-b625-434f-8dbe-a3086db67a0a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:24.381434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Mon Jun 20 14:38:24 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:26.419212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020885-f88b-456b-bd5a-c7972eff6e04 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.419734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020885-f88b-456b-bd5a-c7972eff6e04 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.419734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020885-f88b-456b-bd5a-c7972eff6e04 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.421129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:26.426380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.426797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.426940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.444697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:26.445941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:26.475333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4dff-4045-4708-984c-82343a83776a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.475615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4dff-4045-4708-984c-82343a83776a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.475888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c4dff-4045-4708-984c-82343a83776a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.477330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:26.482338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.482844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.483129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.523185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG passlib.handlers.bcrypt [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86686) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 20 14:38:26.523623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG passlib.handlers.bcrypt [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86686) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 20 14:38:26.531281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:26.554097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:26.569268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:26.570902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:26.579361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:26.662537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa9e94-9cbf-4be2-8068-79ae0f5ddafc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:26.670929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:26.693442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:26.698393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:26.699202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.699489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.699821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.711965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:26.723611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:26.724493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:26.725344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:38:26.730561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:26.797240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b589ca-ff73-4a0d-ad06-3e3d33d3596a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:26.799977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:26.814251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:26.833108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c55ded-9599-4c31-bc70-5d86efe9cf00 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:26.837245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:26.838154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.838443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.838719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.867922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:26.868625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:26.868928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:26.869202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:26.869962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:26.870273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:26.871705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:26.883718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 8/15] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:26.889439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:26.908804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:26.910343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:26.993559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad246bb6-9bd2-4819-8076-76cfdd95a120 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:27.012653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 14:38:27.019139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:27.024000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:27.032113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:27.033048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:27.033335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:27.033611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:27.034854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:27.036362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:27.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:26 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:27.043332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:27.058790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:27.126031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763a123-7c84-4280-86ab-3892b0cca0bf None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:27.148113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c4afe-e825-42f8-aa51-a06366b42f4c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:27.160709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:27.161653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:27.161936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:27.162197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:27.183358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:27.184862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:27.185028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:27.185724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:27.186002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:27.186277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:27.187643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:27.189166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:27.191106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 10/18] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:27.196932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:38:27.206795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:27.207614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:27.208536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:38:27.208536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:38:27.208536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:38:27.208536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:27.208536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 9/19] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:27.213591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:27.270228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:27.276993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:27.298710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb618a-99a3-4386-81c0-3cf30be45d4a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:27.314798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea080-50d6-4eea-bb54-b2055c2824de None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:27.333276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:27.333935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:27.334215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:27.334485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:27.335320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.domain.id=default, user.id=b3edecff66d3402591d4ea9f1c0735a7) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:27.335624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:27.337110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85844e0-c761-433f-b5b1-2a60e6d50c54 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:27.343820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 11/20] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Jun 20 14:38:27 2022] GET /identity/v3/role_assignments?user.id=b3edecff66d3402591d4ea9f1c0735a7&scope.domain.id=default&role.id=695e03655fc54138a800137878e15659 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:27.348108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:27.348764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:27.349055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:27.349334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:27.350084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:27.350395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:27.351837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691368df-6f69-413d-b1d4-a2a6507caa6c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:27.372109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 10/21] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:29.689470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102340-fff4-4cd4-99ea-9b55ebb2e507 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.690019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102340-fff4-4cd4-99ea-9b55ebb2e507 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.690019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f102340-fff4-4cd4-99ea-9b55ebb2e507 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.691912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 12/22] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:29.697672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.698082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.698288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.725823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:29.727074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:29.758158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ddc0-ef94-4457-9e6e-d3afbe996c46 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.758725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ddc0-ef94-4457-9e6e-d3afbe996c46 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.759174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ddc0-ef94-4457-9e6e-d3afbe996c46 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.760749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 13/23] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:29.778951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9d99-2944-408a-8a11-2c19cd0cd55f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.779588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9d99-2944-408a-8a11-2c19cd0cd55f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.780063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c9d99-2944-408a-8a11-2c19cd0cd55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.813734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b14c9d99-2944-408a-8a11-2c19cd0cd55f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:29.815398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b14c9d99-2944-408a-8a11-2c19cd0cd55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:29.832382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 11/24] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:29.875120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:29.918174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 14/25] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:29.919759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ace3-4af6-4a32-b746-6c788c653dac None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.920205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ace3-4af6-4a32-b746-6c788c653dac None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.920492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19ace3-4af6-4a32-b746-6c788c653dac None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.923024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 15/26] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:29.933506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:29.933805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:29.934091 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:29.973646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:29.974776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:29.981739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.046323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a70d1-b080-4d96-a14e-80143aca3549 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.083304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 16/27] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:30.085475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.089107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.090146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.090622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.091084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.094208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.119776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:30.130895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:30.131742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:30.132459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:30.143085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 12/28] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:38:30.145582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.295967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c068e-f3e2-475f-8d95-2dc0452e38f4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.300468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e69fa4-cd9e-4909-b6a5-bba2bd82c40d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.304525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.334305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.335375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.335853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.336329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.337331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.338940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc477a-a4eb-468a-8e6f-7042fb1c21d4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:30.397217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.398045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.398332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.398612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.413253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.414801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:38:30.434069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:30.434841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:30.435618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:38:30.435618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:38:30.435618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:38:30.435618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:30.435618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 17/29] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:30.441078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.488700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 13/30] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jun 20 14:38:30 2022] POST /identity/v3/roles => generated 219 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:30.490852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca458164-51d0-47f9-8356-ccca6a90b5e7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.491380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca458164-51d0-47f9-8356-ccca6a90b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.491866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca458164-51d0-47f9-8356-ccca6a90b5e7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.493619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.494447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 14/31] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:30.495552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca458164-51d0-47f9-8356-ccca6a90b5e7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.583638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45960e7e-802c-4931-9dd7-0442ffa1dae5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.660592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.661301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.661581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.661856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.663769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:30.664079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.667150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f40ac-c1bf-477a-8b72-1debb72c4b6b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:30.683768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 18/32] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:30.686279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.686695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.686974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.701006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca458164-51d0-47f9-8356-ccca6a90b5e7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.711936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:30.713217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:30.744231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.744936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.745270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.745550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.746393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:30.746729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.748333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:30.763822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 15/33] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:30.765037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.800529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.804896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 19/34] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:30.805833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.865346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:30.883371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a9f6-5df4-42a5-8e6e-40fa51af7989 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.921430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.922634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.922918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.923195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.924989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.925488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd8988-ab3a-475d-b69a-f8e0449f54ef None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:30.926458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:30.928501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 16/35] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:30 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:30.929132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:30.964449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:30.965254 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:30.965542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:30.965823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:30.966544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:30.968900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733ed56-53ed-4846-b1ce-2790abb950d5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.043236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:31.050322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d417b-5d95-42d9-9c22-6892240ec2f5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.085741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.086694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.087115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.087527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.088415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.090142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.106907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 17/36] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jun 20 14:38:30 2022] POST /identity/v3/roles => generated 225 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:31.108014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:31.123147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 20/37] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:38:30 2022] POST /identity/v3/projects => generated 301 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:31.220704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd63f-7cfc-4b40-b51e-37cc76073d47 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.222391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd63f-7cfc-4b40-b51e-37cc76073d47 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.222703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466dd63f-7cfc-4b40-b51e-37cc76073d47 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.224410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 21/38] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:31.232497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.232863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.233102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.242203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3bf47-7413-4bce-97d7-a92588acf6f4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.253596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:31.255310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:31.285612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.286886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.287501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.287966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.289779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.291659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.294017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 18/39] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:31.299154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:31.330771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:31.337298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 22/40] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:31.367134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:31.406534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:31.428564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c5afa-7b40-4db6-a134-293105169b92 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.466484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.467374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.467679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.468034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] PATH_INFO: `/v3/domains/default/users/b3edecff66d3402591d4ea9f1c0735a7/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.470148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b3edecff66d3402591d4ea9f1c0735a7, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.471607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcd66e-5090-437a-af12-5470246df6aa None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.486146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 19/41] 10.222.0.23 () {58 vars in 1361 bytes} [Mon Jun 20 14:38:31 2022] PUT /identity/v3/domains/default/users/b3edecff66d3402591d4ea9f1c0735a7/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:38:31.487409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb7ba-e08c-483e-a9a9-b50c03e993aa None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.487722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb7ba-e08c-483e-a9a9-b50c03e993aa None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.487995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bb7ba-e08c-483e-a9a9-b50c03e993aa None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.489465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 20/42] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:31.489575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9103d6-f486-4672-932b-c54201f51dca None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.495122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.495414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.495694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.514589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:31.516637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:31.533094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.534086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.534378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.534654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.535958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.537667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.539637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 23/43] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:31.545319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:31.592274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:31.616094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:31.632614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:31.732369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1cb42-9bca-4d25-ab35-6ce0916ea599 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.763540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:31.768144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35066c65-1c8c-45d0-be2e-d214ed4577f7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:31.770410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.771105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.771391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.771667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.772443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.773897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091063cc-58ae-42f8-a63c-d04acafc12f1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.800982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jun 20 14:38:31 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:38:31.816709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:31.817415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:31.817698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:31.817973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:31.818707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:31.820238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0493d-3a26-4b67-ad03-e4f0324a0918 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:31.850059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:38:31 2022] POST /identity/v3/projects => generated 312 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:38:33.507688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d6c2-f897-4d98-9423-9a661ca8249a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.508229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d6c2-f897-4d98-9423-9a661ca8249a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.508229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d6c2-f897-4d98-9423-9a661ca8249a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.509829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 23/47] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:33.514988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.515727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.515727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.532599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:33.533808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:33.602314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 25/48] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:33.625591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d6c2-f897-4d98-9423-9a661ca8249a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:33.700166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:33.731560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d6c2-f897-4d98-9423-9a661ca8249a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:33.765955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:33.766672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.766954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.767230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.777827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-eddbb3a3-17d3-43dd-b9f7-3f395e92173d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:33.785518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:33.786471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:33.787454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 24/49] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:33.794310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:33.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e519-2172-4007-9ade-ecd1c0e8037a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.878453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:33.878542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e519-2172-4007-9ade-ecd1c0e8037a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.879182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390e519-2172-4007-9ade-ecd1c0e8037a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.880576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 25/50] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:33.885595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.885886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.886166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.899235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85275729-2648-46dd-ae1c-329a2d842c4c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:33.903629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:33.904873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:33.936186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:33.936939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:33.937368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:33.937646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:33.938418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:33.938729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:33.940153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:33.949088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 26/51] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:33.954762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:33.977248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 26/52] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:34.000260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:34.055969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21ec9-4da6-4e0d-a3d3-33fb91c7d1e5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:34.062616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:34.089814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:34.090699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:34.090984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:34.091262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:34.092487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:34.094265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:34.095933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:33 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:34.101221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f4a8-8d54-45ca-8d78-22d119f6e87e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:34.101370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:34.113471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:34.134904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:34.135707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:34.135992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:34.136269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:34.137469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:34.138951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:34.140630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 27/54] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:34.146067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:34.206545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457040f7-8cd9-456a-b43d-ce879389c80c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:34.242605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:34.243406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:34.243690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:34.243966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:34.245195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:34.246675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:34.248307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:34.248425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d2d43-7ce6-4ab9-95a7-297c52980ce1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:34.254058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:34.343064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:34.367821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f1874-6e4d-418a-bc8b-3b2ca5f1fdf0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:34.384397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:34.390934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:34.391606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:34.391893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:34.392164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:34.392924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:34.394370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911d797-dff0-4dcd-8674-a9d5231e9ebb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:34.404214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:34.404897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:34.405271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:34.405557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:34.406391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.domain.id=default, user.id=b3edecff66d3402591d4ea9f1c0735a7) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:34.406701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:34.408160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6bd6-3883-4706-8591-4ca26ec2ea78 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:34.414740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1322 bytes} [Mon Jun 20 14:38:34 2022] GET /identity/v3/role_assignments?user.id=b3edecff66d3402591d4ea9f1c0735a7&scope.domain.id=default&role.id=695e03655fc54138a800137878e15659 => generated 530 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:34.422212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Jun 20 14:38:34 2022] POST /identity/v3/projects => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:38:36.497973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275d6-7eeb-42d9-bea0-6176413204e6 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:36.498826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275d6-7eeb-42d9-bea0-6176413204e6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:36.499316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee275d6-7eeb-42d9-bea0-6176413204e6 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:36.500616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:36.505982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:36.506397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:36.506557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:36.524582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:36.525841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:36.599537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:36.625665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee275d6-7eeb-42d9-bea0-6176413204e6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:36.758890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee275d6-7eeb-42d9-bea0-6176413204e6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:36.794930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:36.795723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:36.796045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:36.796325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:36.797667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:36.799137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e09dd-07cf-444e-b1ba-49c0fd4ce15a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:36.800774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:36.807434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:36.934563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3933b03-ea8d-4310-9e1d-1466aa31339a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:36.948433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:36.973441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:36.974108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:36.974392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:36.974670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:36.975387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:36.976875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c2702-704d-4e39-b447-68cbaabfbf47 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:37.009465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:38:36 2022] POST /identity/v3/users => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:40.184843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05295-6f53-4fef-93c4-96fdea9838bc None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.185887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05295-6f53-4fef-93c4-96fdea9838bc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.186375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d05295-6f53-4fef-93c4-96fdea9838bc None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.189001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:40.203511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.204457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.205018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.234434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:40.236019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:40.283582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358a16-aa11-4b87-a1c3-f2d72ef53819 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.284239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358a16-aa11-4b87-a1c3-f2d72ef53819 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.284766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb358a16-aa11-4b87-a1c3-f2d72ef53819 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.286444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 33/63] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:40.312764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7f33-1892-4e92-840d-eb4dc42de44f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.313379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7f33-1892-4e92-840d-eb4dc42de44f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.313857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb7f33-1892-4e92-840d-eb4dc42de44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.319535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 31/64] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:40.343328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.353766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c1cb7f33-1892-4e92-840d-eb4dc42de44f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:40.355010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c1cb7f33-1892-4e92-840d-eb4dc42de44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:40.358125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:40.459555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:40.468232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54588c07-dee4-4e08-928e-a5ef570a0fc9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:40.486184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 34/65] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:40.494322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ed9d-e265-4338-9e9e-0e36e0a3c73b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.494769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ed9d-e265-4338-9e9e-0e36e0a3c73b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.495180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555ed9d-e265-4338-9e9e-0e36e0a3c73b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.496998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 35/66] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:40.509884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:40.510691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.511079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.511457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.515116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.515561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.515983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.522971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:40.531042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:40.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:40.532783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:40.535210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 32/67] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:38:40.536236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.540744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:40.540744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:40.612308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 36/68] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:40.613517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.666095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da0c-3438-4bd2-9780-50f4115a206b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:40.691319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:40.703817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:40.704632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.704959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.705240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.715717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-08807e50-9574-4195-979a-cec5300a63fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:40.723777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:40.724600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:40.725449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 33/69] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:40.726055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ad18-8c09-4d7b-a2b8-82acf77ed587 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:40.731736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c93391-f1c0-4dd8-92b1-1d1111702042 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.731736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c93391-f1c0-4dd8-92b1-1d1111702042 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.731736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c93391-f1c0-4dd8-92b1-1d1111702042 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.731736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 34/70] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:40.731736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c93391-f1c0-4dd8-92b1-1d1111702042 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.751864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:40.769283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:40.769967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.770254 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.770533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.771301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:40.771618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:40.773065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:40.782360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 37/71] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:40.787841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.840404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c93391-f1c0-4dd8-92b1-1d1111702042 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:40.872844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:40.873660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.873973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.874280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.884380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:40.887499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9edbc-b630-4245-92b3-51cd89e3c337 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-118fa77e-710a-4963-a482-4063e16be072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:40.892907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:40.893748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:40.894464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 35/72] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:40.896119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151dc5-fd91-46b1-acc1-832880dc37ce None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.896389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151dc5-fd91-46b1-acc1-832880dc37ce None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.896671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151dc5-fd91-46b1-acc1-832880dc37ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.914131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e3151dc5-fd91-46b1-acc1-832880dc37ce None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:40.915392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e3151dc5-fd91-46b1-acc1-832880dc37ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:40.918247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:40.924423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:40.925118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.925408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.925688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.926449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:40.926756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:40.928184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:40.936808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 38/73] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:40.937575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 36/74] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e1ef-1f35-48da-ac2b-8acc166338a4 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e1ef-1f35-48da-ac2b-8acc166338a4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6e1ef-1f35-48da-ac2b-8acc166338a4 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 37/75] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:40.987814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e1ef-1f35-48da-ac2b-8acc166338a4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.011285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.046491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ad852-eb39-4333-b92b-3736acbf23d3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.081658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.082546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.082832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.083110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.084432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.085972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.087653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.088424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.111293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6e1ef-1f35-48da-ac2b-8acc166338a4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.146675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.147346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.147632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.147911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.148451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.148667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:41.149011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.150415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb1e01-b042-4c7a-879d-7f9efc9466f5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.162077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 38/77] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.163312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.163583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.163851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.180241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:41.181504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:41.189400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf77cc2-1fca-4cd9-af37-bff14b15d92c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.227774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.228665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.228977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.229251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.242938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.243881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.244420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.246228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 40/78] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.247172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.252989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:41.253767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.346807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea06d2-4a18-4f54-a6d4-fc8d9114fe8e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.353667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e885-5e63-43c4-adba-d935ccca8154 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.368677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.384623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.385465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.385753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.386029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.386721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.387408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.387727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.387990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.396323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:41.404142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:41.405033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:41.406211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:41.406811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.456767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.459302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.460826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.506988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908f833-febc-4b85-a5cc-e32670c60729 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.540076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.540977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.541260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.541534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.542731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.544192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.546131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 42/81] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.546772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.563357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 40/82] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:41.564204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.595816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.645005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc777dde-f1f8-4947-b63b-a89ec46ded26 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.657644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.660690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784986c-6b0b-4716-96f6-a46723330a1c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.678032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.678684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.678975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.679247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.696259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.697091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.697372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.697645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.698965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.700453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.702169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.707203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.754686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.756193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.805563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.807680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1e4cf-fe20-426f-a74d-11c5a81a2ffa None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.842784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.843528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.843809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.844085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:41.845178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:41.846538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:41.854468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 42/84] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:41.855249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.859124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 43/85] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:41.860007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:41.892736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:41.963830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225657b-e42e-497b-8c06-0fa30f1b8ab2 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.964045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185cc0da-68ba-4203-ad67-a64822170786 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:41.998010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.998483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:41.998664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.998997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:41.999279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:41.999408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:41.999758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.000041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.001251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.002729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.004477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 44/86] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.007697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.028326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.068698 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.070223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.098955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.109373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7de13-b6e9-4943-bb42-80ea8846fbb6 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.142596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.143262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.143548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.143825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.144548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.146062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.170246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:42.171240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.173861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 45/88] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:38:42 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:42.174701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.264706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.290607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f901fe-0f45-4cef-bfb8-17ec8170450f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.300553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0fd98-b76c-485c-aa96-54bb27ebf44f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.325212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.332333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.333277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.333566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.333839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.335126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.336664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.338379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 44/89] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.339181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.340636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.342011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.342460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.343927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.345443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.347217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.349701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 46/90] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.351176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.460376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc91b8-8ff6-4ed3-a92d-c91e9a31e1e7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.463831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ad1f4-6ddf-44ca-8041-c6203b881c16 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.505277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.506319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.506667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.507002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.508307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.509190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.509861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.509955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.510148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.510429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.511282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b3edecff66d3402591d4ea9f1c0735a7) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:42.511651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 47/91] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.511884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.512489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.513532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.523799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 45/92] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/role_assignments?user.id=b3edecff66d3402591d4ea9f1c0735a7&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.524598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.527474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.677109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.695130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8940c5-2a5b-49db-9ef0-67833284362a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.759228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c112a3c-7b1b-4b35-b77e-384cdab6872e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:42.772560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.773569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.774097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.774562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.826334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:42.827390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:42.827497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:42.827709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:42.828677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:42.829019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.830664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.847465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 46/93] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=75014435b442408ea67a373f2483e12c => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:42.847465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:42.869423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:42.871714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:42.885121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:42.990316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 48/94] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:42.998030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:43.057028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31e44b-45f3-4575-9db6-d0f27d695825 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:43.084330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:43.094878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:43.095885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:43.096364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:43.096874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:43.097937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:43.098446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:43.100095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:43.106350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 47/95] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:43.187740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61124a07-8a98-4795-9f3a-32c6cacf75f0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:43.201661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:43.242066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:43.243305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:43.243786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:43.244253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] PATH_INFO: `/v3/projects/56dd30d28b414400b605cb4b92fcdec6` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:43.245723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] RBAC: Authorizing `identity:get_project(project_id=56dd30d28b414400b605cb4b92fcdec6)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:43.247399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e428b9-1e7a-4b21-ab67-9337ae7486dc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:43.249866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 49/96] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:42 2022] GET /identity/v3/projects/56dd30d28b414400b605cb4b92fcdec6 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:43.255899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:43.413067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedd72b-cd9e-4817-86a9-0341715c0278 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:43.453124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:43.453800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:43.454088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:43.454370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:43.455222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=56dd30d28b414400b605cb4b92fcdec6, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:43.455541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:43.457035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d532fc8-c270-4c7d-8e2d-44c16522c713 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:43.470144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 48/97] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:43 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=56dd30d28b414400b605cb4b92fcdec6&role.id=75014435b442408ea67a373f2483e12c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:45.367873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34594a4f-fde8-4ef2-8bac-848be9c60934 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.370572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34594a4f-fde8-4ef2-8bac-848be9c60934 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.370572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34594a4f-fde8-4ef2-8bac-848be9c60934 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.371042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 50/98] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:45.376661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.377527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.378010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.391306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb836c-87ad-4613-85a5-f2d15a2ad312 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.391651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb836c-87ad-4613-85a5-f2d15a2ad312 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.391937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb836c-87ad-4613-85a5-f2d15a2ad312 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.393473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 51/99] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:45.398557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.398841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.399120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.418676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:45.420641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:45.433785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:45.435008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:45.513570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:45.544563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:45.556373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:45.582099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:45.604354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:45.744402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5c44f-9ce9-4dea-bd9a-4758b71db58e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:45.788260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2610f-a125-4330-9f97-353985e4b7e5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:45.808075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:45.809109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:45.809495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.809981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.810436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.825100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:45.833460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:45.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:45.835006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:45.837387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 50/102] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:45.845834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:45.862651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:45.863860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.864331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.864832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.882582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-06edfb69-9aba-4419-818c-c1226ef2c7ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:45.896427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:45.897354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:45.898115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:45.901980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 53/103] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:45.905540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1808-2440-456f-ba16-42d44c3fdfa3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:45.906662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1808-2440-456f-ba16-42d44c3fdfa3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:45.907306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda1808-2440-456f-ba16-42d44c3fdfa3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:45.909916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 54/104] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:45.911498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1808-2440-456f-ba16-42d44c3fdfa3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:45.937666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.000606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58189f9e-8840-42e0-bf0c-d9e7b29dc410 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.042187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.043294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.043645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.043984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.044859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:46.045230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.047034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd1d62-ebd2-4427-a003-068f32f865e7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.056518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 51/105] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.061400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.061400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.061400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.064506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda1808-2440-456f-ba16-42d44c3fdfa3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.078372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:46.079653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:46.107330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.109201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.109956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.110449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.112037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:46.112832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.114856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0079f-bee5-4631-96ac-ddf0f3cc2aae None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.127416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 55/106] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.129723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4edb-bef6-4e9a-baf5-2f68907799a4 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.130215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4edb-bef6-4e9a-baf5-2f68907799a4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.131127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4edb-bef6-4e9a-baf5-2f68907799a4 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.136752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 56/107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:46.138821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4edb-bef6-4e9a-baf5-2f68907799a4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.156090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 52/108] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:46.157363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.173940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.197760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.276015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8448646-bc17-468c-b8f4-bfa28f320d98 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.282571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4edb-bef6-4e9a-baf5-2f68907799a4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.312206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.313151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.313434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.313711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.314940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.316747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f98ce-60f9-4ff5-af17-4a819b984649 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.318431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 53/109] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.318431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240893f-8606-4c3a-a311-bc5edcc5f8cd None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.318431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240893f-8606-4c3a-a311-bc5edcc5f8cd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.318431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240893f-8606-4c3a-a311-bc5edcc5f8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.329277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.330163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.330445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.330740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] PATH_INFO: `/v3/users/3b67d7f40e5d4463b4b31dada85ad725` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.336634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4240893f-8606-4c3a-a311-bc5edcc5f8cd None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:46.337871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4240893f-8606-4c3a-a311-bc5edcc5f8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:46.344212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] RBAC: Authorizing `identity:get_user(user_id=3b67d7f40e5d4463b4b31dada85ad725)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.345736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.348750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 57/110] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/users/3b67d7f40e5d4463b4b31dada85ad725 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.348750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.402490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 54/111] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:46.406278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b891-4198-4cbc-9873-49da21cadee1 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.406572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b891-4198-4cbc-9873-49da21cadee1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.406861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52b891-4198-4cbc-9873-49da21cadee1 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.408159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 55/112] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:46.409245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f4a6-3e4e-480a-b4f5-465430ab4f10 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.409578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f4a6-3e4e-480a-b4f5-465430ab4f10 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.409858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21f4a6-3e4e-480a-b4f5-465430ab4f10 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.411186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 56/113] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:46.411799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f4a6-3e4e-480a-b4f5-465430ab4f10 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.437009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.450366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.452768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78072b-45fd-482d-a771-c7e8e94122b9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.486904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.487709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.487993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.488267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.489472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.491002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.492669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 58/114] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.493445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.515865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21f4a6-3e4e-480a-b4f5-465430ab4f10 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.549630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.550427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.550709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.550980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.552180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.553679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7c7b8-c2a1-42ec-9605-329a07effed3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.555542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 57/115] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:46.561369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcfc4f-a830-4194-8c01-f5619eee8d41 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.561665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcfc4f-a830-4194-8c01-f5619eee8d41 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.561941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddcfc4f-a830-4194-8c01-f5619eee8d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.578352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cddcfc4f-a830-4194-8c01-f5619eee8d41 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:46.579638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cddcfc4f-a830-4194-8c01-f5619eee8d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:46.594982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72423-bb6f-4bbb-a403-892db6e916b3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.628509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.629196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.629503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.629767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.645399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 58/116] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:46.646663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.646958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.647237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.658963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.670280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:46.671570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:46.697731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.699707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.701314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.738819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 59/117] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:46.741626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.802513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 59/118] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:46.803326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.843119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcb959-2317-491b-8cf6-9492c857519d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.856385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.877459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.878260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.878544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.878820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.889111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:46.896705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:46.897606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:46.898531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 60/119] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:46.899381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:46.902266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd17ea-2bb2-4b2f-ae41-f1847178d825 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:46.927227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:46.938779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:46.939459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:46.939762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:46.940036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:46.940802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:46.942601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:46.970476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 60/120] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:38:46 2022] POST /identity/v3/projects => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:46.977810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.011715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef6a38-79c1-46e2-8bfc-2be54cfdba01 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.055736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.056604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.056903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.057174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/users/b6591b35cbee414c9fc297e019619805/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.059284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, user_id=b6591b35cbee414c9fc297e019619805, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.061222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.076406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 61/121] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:38:46 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/users/b6591b35cbee414c9fc297e019619805/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:38:47.077138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.101941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a843fc-87be-4650-9574-6d5fc75d0ea3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.110451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.147637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.148068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.148342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.148615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.161626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:47.170093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:47.171537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:47.172310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 61/122] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:38:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:47.173035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.200460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.224772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68018-7f34-40ee-a164-7cd8acfaf0d8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.261852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.262680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.262966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.263249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.277623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:47.286844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:47.287788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:47.288533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 62/123] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:47.289777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.301205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e915b7-519f-4e1e-8464-7aed864ae0bd None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.342799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.344218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.344508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.344901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.346136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.348099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.350258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 62/124] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.351524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.395961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.419777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a866-b7d9-4496-8619-b02b5ea42e83 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.455549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.455983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.456273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.456550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.457348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:47.457657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.459049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.467720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 63/125] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.468844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.472336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.478652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c9879-e93a-4638-bf3b-35c3d2322f7b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.517235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.518293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.518768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.519233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.520177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:47.520673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.522385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.532734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 63/126] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.533932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.605987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddb5a-f9ba-43c6-93b8-f8f6e85d3bc9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.637257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.645857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b4a51-c701-4308-863c-13790f0530f0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.652849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.654266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.654751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.655920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.657310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:47.657845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.659938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.671836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 64/127] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.673185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.681706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.682437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.682722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.682999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.683889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=3b67d7f40e5d4463b4b31dada85ad725) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:47.684207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.685742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.697950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 64/128] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/role_assignments?user.id=3b67d7f40e5d4463b4b31dada85ad725&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.697950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.789123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:47.829857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b78fc6-5347-4eec-8807-bcc29c710a8c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.869092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.870333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.871243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.871721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.873225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.875523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.877546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 65/129] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.878720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:47.918292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d24d0a2-f22f-4fd0-b7b7-545c0e249d52 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:47.960191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:47.961885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:47.962370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:47.962976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:47.964386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:47.966672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:47.969311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 65/130] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:47.970526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.005319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:48.051503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b79e-9157-4fc1-86f6-b8b01cf8ca17 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.089281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f43e8-6b2f-4741-b130-1b2ff17a82a6 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.130964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.131907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.133439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.134354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.134851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.135342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.135807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.136268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.138350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.139205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.142373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.142803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.144689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 66/131] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:48.146630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 66/132] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:47 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:48.147648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.150344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.172135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:48.288618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75267711-bdcb-490e-b14b-3a6ca8798f64 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.325151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.326566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.327196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.327666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.329206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.330912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.334471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 67/133] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:48 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:48.335689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.364637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:48.379430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487f67-8adb-400c-ab89-7f155b397c3b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.421305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:48.453389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edf41-0045-420e-890f-5eb6ed773c2b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.453966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.455087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.455397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.455681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] PATH_INFO: `/v3/projects/56dd30d28b414400b605cb4b92fcdec6` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.461455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] RBAC: Authorizing `identity:get_project(project_id=56dd30d28b414400b605cb4b92fcdec6)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.462953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.465028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 67/134] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:48 2022] GET /identity/v3/projects/56dd30d28b414400b605cb4b92fcdec6 => generated 312 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:48.465802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.491376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.492755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.493359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.493896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/users/b3edecff66d3402591d4ea9f1c0735a7/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.496334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, user_id=b3edecff66d3402591d4ea9f1c0735a7, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.498177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.517254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 68/135] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:38:48 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/users/b3edecff66d3402591d4ea9f1c0735a7/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:38:48.519058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:48.656322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48012c-89a6-4373-84f2-be27064fb898 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.729761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.730718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002df62-826f-43e3-9733-3903d7bbc9e8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:48.731316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.731795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.732583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/users/b6591b35cbee414c9fc297e019619805/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.736295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, user_id=b6591b35cbee414c9fc297e019619805, role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.738103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8909e081-dd18-403b-abb6-59fea0b5a908 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.764048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 68/136] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:38:48 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/users/b6591b35cbee414c9fc297e019619805/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:38:48.771722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:48.786318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:48.787260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:48.787551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:48.787836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] PATH_INFO: `/v3/projects/56dd30d28b414400b605cb4b92fcdec6/users/b6591b35cbee414c9fc297e019619805/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:48.794449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] RBAC: Authorizing `identity:create_grant(project_id=56dd30d28b414400b605cb4b92fcdec6, user_id=b6591b35cbee414c9fc297e019619805, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:48.796294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d9f93-d2df-41c9-9db3-5989454b8623 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:48.821019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 69/137] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:38:48 2022] PUT /identity/v3/projects/56dd30d28b414400b605cb4b92fcdec6/users/b6591b35cbee414c9fc297e019619805/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:38:49.506137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0581-c00d-4dba-9100-8da467e952a8 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.506843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0581-c00d-4dba-9100-8da467e952a8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.507325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa0581-c00d-4dba-9100-8da467e952a8 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.508968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 69/138] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:49.514201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.515082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.515629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.534087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e7c7-07ac-4e00-8ef3-cdcd6f51a159 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.534701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e7c7-07ac-4e00-8ef3-cdcd6f51a159 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.535173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9e7c7-07ac-4e00-8ef3-cdcd6f51a159 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.536760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 70/139] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:49.538078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:49.539528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:49.541839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.542342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.542810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.559955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:49.561592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:49.594792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:49.664564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 70/140] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:49.684325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 71/141] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:49.701235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:49.726252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:49.875290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e0ba0-63f5-42d9-8926-ee3be6f8d1d7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:49.898408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd1a0e-0bae-4c04-ba2b-7359f43746db None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:49.910932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:49.940730 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:49.941877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.942163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.942438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.959949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:49.965689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:49.966494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:49.966824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:49.967103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:49.972035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:49.973543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:49.976362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 72/142] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:49.978106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:49.978976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:49.979748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 71/143] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:49.985179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:49.988853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:50.020675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:50.145118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c2577-d5be-4923-b989-a21dc6044947 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:50.179510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136cbe5-d0cd-4af3-9b94-cc245f75d969 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:50.196374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:50.197095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.197380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.198128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.198874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:50.200445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:50.237961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 73/144] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:38:49 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:50.265982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:50.266681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.266967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.267239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.268002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:50.268305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:50.269765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:50.285319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 72/145] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:50.290952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:50.444982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:50.480177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c2180-a390-4fd3-9ef9-87ad63ae568b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:50.532620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:50.533544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.533929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.534240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.535524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:50.541280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126baa26-e782-4ff7-8ecb-777ebdb2556f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:50.543170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 74/146] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:50 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:50.548911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:50.620640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:50.693229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ffe36-eb32-4884-be24-d9f9872de6dc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:50.729691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:50.730668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.731158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.731642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.776453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00eb94-95e7-4589-a1ba-d68cf7f1b6f0 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.777440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00eb94-95e7-4589-a1ba-d68cf7f1b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.777919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00eb94-95e7-4589-a1ba-d68cf7f1b6f0 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.779511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 75/147] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:50.784781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:50.785306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:50.785785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:50.805147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:50.806388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:50.813445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:50.815413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:50.862008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:50.923436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:50.929306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:50.939625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 76/149] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:50.970234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.039381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d6c009-f7b5-4030-9069-a101b2b982a6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.075900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.077059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.077449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.077823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.079253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:51.084736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:51.084736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 74/150] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:50 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:51.088625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.102277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:51.166878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:51.198452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99f959-e1aa-4da7-8979-42d5a6f19968 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.235148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e4aa0-1cb3-4eea-af6d-1aae7f4feabc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.235825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.236594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.236992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.237364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.239749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:51.239749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:51.240234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:51.248678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 75/151] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=75014435b442408ea67a373f2483e12c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:51.300499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.301586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.302030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.302450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.325177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:51.333583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:51.334680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:51.335691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:51.337794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 77/152] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:38:51.344058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.449922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:51.481435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c891659-9b4c-4f70-b488-46d14c70c2d7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.519301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.519984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.520266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.520541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.523393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:51.523705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:51.525155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b46d81-3e77-40a3-b922-a88b65ff48a6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:51.534912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 76/153] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:51.540799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.582568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bee2e-fa50-424a-8014-25d54ea02eb2 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.583067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bee2e-fa50-424a-8014-25d54ea02eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.583235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695bee2e-fa50-424a-8014-25d54ea02eb2 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.584594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 77/154] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:51.591201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.591501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.591773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.613524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:51.614880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:51.699180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 78/155] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:51.713231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed6784-815f-4044-afbf-0b454261daa5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.751855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.780894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.781797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.782078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.782350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] PATH_INFO: `/v3/users/3b67d7f40e5d4463b4b31dada85ad725` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.783629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] RBAC: Authorizing `identity:get_user(user_id=3b67d7f40e5d4463b4b31dada85ad725)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:51.786322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:51.788303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 78/156] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/users/3b67d7f40e5d4463b4b31dada85ad725 => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:51.795273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.799433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:51.860961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:51.911354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1fe6f-ea49-451c-94b6-b68962ad943a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.942286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5de3-5cb9-4f12-b7bc-8467fdfd9e00 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:51.952271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.953034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.953355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.953627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.965319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-ceeb20f9-ff8d-4531-9c67-0c5604fcb686 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:51.973786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:51.974987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:51.976016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 79/157] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:51.976860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ef12-6660-4f22-8f12-35e51eeb94f9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.976986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ef12-6660-4f22-8f12-35e51eeb94f9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.977208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ef12-6660-4f22-8f12-35e51eeb94f9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.978756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 80/158] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:51.983137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ef12-6660-4f22-8f12-35e51eeb94f9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:51.985094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:51.986658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.987276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.987703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:51.989174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:51.990856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa968ca1-627d-498b-b871-ec89270d1435 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:51.992857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 79/159] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:51.995840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:51.996382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:51.996867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.020517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:52.022150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:52.095911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ef12-6660-4f22-8f12-35e51eeb94f9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.131216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.131818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.132099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.132373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.133282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:52.133713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.135060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.138090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 80/160] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:52.138945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.143637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.145792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.157347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 81/161] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:52.163842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.277116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0ea26-2d7e-446f-bffc-ca3a23629136 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.315920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.317164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.317441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.317713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] PATH_INFO: `/v3/users/b3edecff66d3402591d4ea9f1c0735a7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.319377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] RBAC: Authorizing `identity:get_user(user_id=b3edecff66d3402591d4ea9f1c0735a7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.320933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.323165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 82/162] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/users/b3edecff66d3402591d4ea9f1c0735a7 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:52.324068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.326343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c7644-2652-4397-b4ea-958e7222ec37 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.385850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.393067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.394284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.394759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.395220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/users/3b67d7f40e5d4463b4b31dada85ad725/roles/3bebcbcd0d06486aa916e0054e57b2b5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.400797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, user_id=3b67d7f40e5d4463b4b31dada85ad725, role_id=3bebcbcd0d06486aa916e0054e57b2b5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.402654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.420472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 81/163] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:38:52 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/users/3b67d7f40e5d4463b4b31dada85ad725/roles/3bebcbcd0d06486aa916e0054e57b2b5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:38:52.421821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.446791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f0bd6-fc85-4c90-a74f-f60217ceb223 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.510800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.511666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.511946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.512221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.525085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.534018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:52.547373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:52.548272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:52.549104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 83/164] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:52.554699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.570839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a6069-5761-497d-b145-68047d0bb279 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.646126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.648177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.648843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.650468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.732284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156933-8472-4996-af38-9e41c62c2b01 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.739558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.741548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856cd7d7-3fed-4f43-916e-eac9f164f324 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.751458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.770671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.771425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.771624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.771897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.772658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:52.773230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.774373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ee3d9-44a2-4ecb-883b-7ca50c653362 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.784410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 84/165] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:52.789828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce407-7eac-4760-b704-93215c3ab05c None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.790175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce407-7eac-4760-b704-93215c3ab05c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.790492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ce407-7eac-4760-b704-93215c3ab05c None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.791831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 85/166] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:52.792942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce407-7eac-4760-b704-93215c3ab05c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.814628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:52.861814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 82/167] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:52.863587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.864071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.864633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.882951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:52.884570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:52.936817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ce407-7eac-4760-b704-93215c3ab05c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:52.960125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 83/168] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:52.961494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:52.988088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:52.989061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:52.989277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:52.989547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:52.990809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:52.992183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:52.993861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 86/169] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:53.000284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.055036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.069258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.079856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc693c5-c37d-468e-beed-c18a4ed77b11 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.112027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471df1ec-3802-43c4-893a-ce38a942bd9a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.116623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.117825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.118360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.118834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.120223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.121929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.124052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 84/170] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:53.125237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.148181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.148878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.149159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.149427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.220209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.221764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.234642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325939d-3d6d-4b32-9713-e90a40b5f29f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.267941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.272373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7c152-4337-4733-934c-350203e47854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.273593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c152-4337-4733-934c-350203e47854 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.274096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c152-4337-4733-934c-350203e47854 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.274608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c152-4337-4733-934c-350203e47854 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.285880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7c152-4337-4733-934c-350203e47854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-40e7c152-4337-4733-934c-350203e47854 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:53.294547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:53.295410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:53.296420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:53.299217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 85/171] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:53.300222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7c152-4337-4733-934c-350203e47854 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.325893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.328254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 87/172] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 14:38:53.333446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.410625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7c152-4337-4733-934c-350203e47854 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.443658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2fff7-fe2c-4b9d-ae25-d10a24dd96f2 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.447869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.448829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.449459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.449954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.451004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b3edecff66d3402591d4ea9f1c0735a7) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:53.451597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.453456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.460678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 86/173] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/role_assignments?user.id=b3edecff66d3402591d4ea9f1c0735a7&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:53.461961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.511503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.512104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.512385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.512654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.513447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:53.513749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.515295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.532258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 88/174] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:53.539774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.567275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.668687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:53.704665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3ca9a-2f07-4b23-a495-750c272a5c1a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.774319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb86d3f-0620-4e2a-8d6d-dfbd991016f7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:53.786109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.788216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.788216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.788216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] PATH_INFO: `/v3/projects/56dd30d28b414400b605cb4b92fcdec6` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.789148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] RBAC: Authorizing `identity:get_project(project_id=56dd30d28b414400b605cb4b92fcdec6)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.790625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.793595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 87/175] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/projects/56dd30d28b414400b605cb4b92fcdec6 => generated 312 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:53.801858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:53.847025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:53.847941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:53.848220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:53.848497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] PATH_INFO: `/v3/users/b6591b35cbee414c9fc297e019619805` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:53.850939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] RBAC: Authorizing `identity:get_user(user_id=b6591b35cbee414c9fc297e019619805)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:53.851467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:53.853763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 89/176] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/users/b6591b35cbee414c9fc297e019619805 => generated 275 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:53.862886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:54.016761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:54.064404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc46c51-6025-4d3f-897c-a4e3f89185dd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:54.078801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977908b-0fe0-4dad-900d-48668884e9fa None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:54.130107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:54.130782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.131068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.131342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.164310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:54.165126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.165410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.165687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.166535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=56dd30d28b414400b605cb4b92fcdec6, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:54.166849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:54.168334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:54.181955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 88/177] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=56dd30d28b414400b605cb4b92fcdec6&role.id=75014435b442408ea67a373f2483e12c => generated 608 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:54.276888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:54.278331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:54.394217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:54.427638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 90/178] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 14:38:54.433874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:54.463810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:54.567277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481fd76-ae9a-468f-89cd-fcff6173cca7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:54.607784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:54.608699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.609002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.609276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.610509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:54.611990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527a8fb-add0-46a9-8353-4bd6b1e0e48e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:54.614049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 89/179] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:54 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:54.619914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:54.765135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcbac7-d743-42b2-a1d7-9bcd68df820c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:54.811974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:54.812747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.813021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.813205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.814055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=b6591b35cbee414c9fc297e019619805) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:54.814381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:54.815865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1999c480-bfbd-439b-a15f-e1f1405e5daf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:54.823109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 91/180] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:54 2022] GET /identity/v3/role_assignments?user.id=b6591b35cbee414c9fc297e019619805&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:54.854584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75aba-13ec-4732-a31b-a31c88c400aa None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.854921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75aba-13ec-4732-a31b-a31c88c400aa None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.855143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a75aba-13ec-4732-a31b-a31c88c400aa None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.856574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 90/181] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:54.862460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c4e0-f5e3-4f00-a152-f070b9db1eb1 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:54.862743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c4e0-f5e3-4f00-a152-f070b9db1eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:54.863017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c4e0-f5e3-4f00-a152-f070b9db1eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:54.886005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9533c4e0-f5e3-4f00-a152-f070b9db1eb1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:54.887238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9533c4e0-f5e3-4f00-a152-f070b9db1eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:54.933094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:54.971407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:54.997804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75aba-13ec-4732-a31b-a31c88c400aa None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.014239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dfef3-0faa-40a3-b847-c47ecd5d5693 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.014633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dfef3-0faa-40a3-b847-c47ecd5d5693 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.014855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2dfef3-0faa-40a3-b847-c47ecd5d5693 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.016750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 93/183] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:55.026555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0d82-a640-4b57-8fd4-321fb96c0fcf None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.026844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0d82-a640-4b57-8fd4-321fb96c0fcf None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.027118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a0d82-a640-4b57-8fd4-321fb96c0fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.049769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c97a0d82-a640-4b57-8fd4-321fb96c0fcf None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:55.051195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c97a0d82-a640-4b57-8fd4-321fb96c0fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:55.126570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.146918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a75aba-13ec-4732-a31b-a31c88c400aa None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.154479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 94/184] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:55.156024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b47e-3d00-4202-ab86-419ae255b9f0 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.156317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b47e-3d00-4202-ab86-419ae255b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.156590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b47e-3d00-4202-ab86-419ae255b9f0 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.158683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 95/185] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:55.163866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.164205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.164487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.186645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:55.187928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:55.188141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.189006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.189283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.189552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.201136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:55.209396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:55.210263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 91/186] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:55.211038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.278569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 96/187] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:55.280881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.317352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.327562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e37f2-316f-4392-ba1c-be330ea960e1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.361132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.361957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.362234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.362504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.372667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:55.381108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:55.381963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:55.382744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 92/188] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:55.383381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.389999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.394051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab75874-a1b1-4833-9549-c4223453d09b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.431406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.432229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.432508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.432808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.433566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:55.433868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.435342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.447180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 97/189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:55.447896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.497727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54a01e-ff09-4775-b02c-8bc5badca5ac None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.533250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.534050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.534325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.534604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.535771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.537298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.543289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 93/190] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:55.543289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.547958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.558577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae174a3-d271-4a6e-ab7f-4a4b46ee2f85 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.593230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.593929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.594211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.594483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.595360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:55.595646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.597039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.610116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 98/191] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:55.610116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.615406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.646845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae92e4a-dd2d-4326-890d-e2f1cb42db4f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.681306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.682184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.682460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.682728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.697631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.699227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.705530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 94/192] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:55.705530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.714816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189496-ebb2-492d-99db-413170f39650 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.748017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.748697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.749063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.749550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.750363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.751832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.772382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 99/193] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:38:55 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:38:55.773331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.787472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.814121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb81e6f-a92f-4af3-ba92-39001f0ff947 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.850729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:55.857971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.859284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.859568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.859841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.861212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:55.862767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe22b7a-3d53-41f1-b3ff-e235b0aa55b2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:55.869115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 95/194] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:55.869115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0123-09ec-4397-9e54-7f10acbf0105 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.869115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0123-09ec-4397-9e54-7f10acbf0105 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.869115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d0123-09ec-4397-9e54-7f10acbf0105 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.869115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 96/195] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:55.873067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0123-09ec-4397-9e54-7f10acbf0105 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:55.896138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9198711-a2f9-4bd0-bb99-175fc357fd62 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:55.934938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:55.934938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:55.935221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:55.935451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:55.992787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d0123-09ec-4397-9e54-7f10acbf0105 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.023180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.024538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967452d-8c38-4518-b947-c0dd711b13a5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.036895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.044635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.045341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.045668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.045949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.126444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.134089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.135561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.159910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 100/196] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:56.161883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.162395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.162860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.188498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:56.190016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:56.245864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 97/197] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:56.246740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.262373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 101/198] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:56.263536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.319270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.370151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888cf17-175d-4cda-98be-0003a9f04e70 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.396861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.402948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93b09-b6f4-42bf-ab2f-58babc94acf5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.417040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.418240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.418731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.419434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.421733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.424003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.425989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 102/199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:56.427499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.441757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.442554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.442835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.443108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.444352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.445911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.447620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 98/200] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:56.452479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.555835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084bce7-cd1e-49f2-ba42-a607f84b77a0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.561637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094fe8b-bcec-4c83-bdae-da07b0c67dd3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.574959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.592828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.593497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.593835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.594109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.595009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=eae865e50dcf48b18854706fe6a98370) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:56.595316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.596812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.603283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 99/201] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/role_assignments?user.id=eae865e50dcf48b18854706fe6a98370&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:56.604095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.613559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.615481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.615972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.616611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.633683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:56.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:56.643778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:38:56.644638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:56.647395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 103/202] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:56.654156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.665699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.788211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779d619-1a83-4919-8242-a0ef6b66b35c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.812641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787704a3-5951-4293-91ff-fba10338ab90 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:56.830838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.832037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.832884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.833354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.834317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:56.834809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.837188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.847571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 104/203] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:56.853816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:56.860534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:56.861363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:56.866282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:56.866282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:56.866282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=eae865e50dcf48b18854706fe6a98370) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:56.866282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:56.866282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:56.870969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 100/204] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/role_assignments?user.id=eae865e50dcf48b18854706fe6a98370&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:56.921534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:56.990671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b15bc-345e-47e5-b09c-37cca2d72563 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:57.026970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:57.032746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:57.032746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:57.032746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] PATH_INFO: `/v3/users/3b67d7f40e5d4463b4b31dada85ad725` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:57.032746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] RBAC: Authorizing `identity:get_user(user_id=3b67d7f40e5d4463b4b31dada85ad725)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:57.032746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:57.033323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 105/205] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:56 2022] GET /identity/v3/users/3b67d7f40e5d4463b4b31dada85ad725 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:57.042008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:57.199147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:57.207802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d00a09-c762-4497-a88b-08fbead61a82 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:57.253675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:57.254580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:57.255008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:57.255425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:57.348179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:57.349643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:57.462297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:57.471368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 101/206] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:38:57.477497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:57.587668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:57.596273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84151247-ad8c-4107-a614-eeb105763436 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:57.643382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:57.644603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:57.645119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:57.645582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:57.647028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:57.648671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04151c99-d72c-4113-8cd6-57287f87458f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:57.650654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 106/207] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:57 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:57.656766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:57.779536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee83061-f7b8-4e0f-8327-613807fd312f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:57.829444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:57.830120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:57.830410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:57.830689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:57.831531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, scope.project.id=5ad0f178bf0142508558a86936961184, user.id=3b67d7f40e5d4463b4b31dada85ad725) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:57.831845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:57.833381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4fc7e-e75c-4870-9c59-d5d8cf0309ee None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:57.839927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 102/208] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:57 2022] GET /identity/v3/role_assignments?user.id=3b67d7f40e5d4463b4b31dada85ad725&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:58.194414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ea42-9f80-4e5d-942a-8d4ee1353340 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.195429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ea42-9f80-4e5d-942a-8d4ee1353340 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.195939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ea42-9f80-4e5d-942a-8d4ee1353340 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.197559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 107/209] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:58.203236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.204097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.204600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.213246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1219-67be-4f98-b1da-31d900c267a1 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.213537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1219-67be-4f98-b1da-31d900c267a1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.213820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab1219-67be-4f98-b1da-31d900c267a1 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.215202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 108/210] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:58.222509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.222800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.223081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.225776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:58.227087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:58.241073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:58.242298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:58.292022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:58.310406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 103/211] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:58.325969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 109/212] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:38:58.336372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.355094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.447544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae88217-a071-44bd-a578-f016dff15d8d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:58.484651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:58.485496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:58.486865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.487299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.488229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.492394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21f4bc-0275-482d-b334-7f3a557ea3f9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:58.500057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:58.508395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:58.509483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:38:58.510354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:38:58.512750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 104/213] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:58.518851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.532279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:58.533146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.533819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.534105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.535494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:58.537692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:58.544174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 110/214] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:58.545332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.574891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:58.629765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b611f5-c9c7-4192-b89f-24060f3ee226 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:58.646514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070eec0-6350-4612-b775-f24a94b2f8b5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:58.665488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:58.666486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.667025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.667496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.668431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:58.668999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:58.670979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:58.681260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 105/215] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:38:58.686435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:58.686435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.686435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.686435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.686769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:58.686769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:58.689663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.709937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 111/216] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:38:58 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:38:58.809238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db681954-9b6b-462d-bb1f-1e060391bfaa None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:58.825081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:58.847035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:58.848304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:58.848803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:58.849263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] PATH_INFO: `/v3/users/6000d8e52e72416f86281ee22d344321` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:58.864968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] RBAC: Authorizing `identity:get_user(user_id=6000d8e52e72416f86281ee22d344321)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:58.866813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0bd8-c166-4008-bfb7-073894f672dc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:58.869142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 106/217] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:58 2022] GET /identity/v3/users/6000d8e52e72416f86281ee22d344321 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:58.874885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:58.898162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:58.984599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891541f-69af-4a92-9753-4b6ce5ee1a1d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.027981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.027981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.028198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.028383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.101252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:59.102677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:59.121925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8bc0-4b9b-44ab-a9c2-7a684b2890b5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.121925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8bc0-4b9b-44ab-a9c2-7a684b2890b5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.122169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b8bc0-4b9b-44ab-a9c2-7a684b2890b5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.123683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 107/218] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:38:59.126310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:59.132074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.132351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.132901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.157584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:59.158838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:59.235964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 108/219] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:59.237871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 112/220] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 14:38:59.244316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.277904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.346625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fb5d6-af41-468e-be40-bba28dd251c9 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.357159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:59.396333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.398672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.398672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.402730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.404232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:59.406868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164cc4-5e99-48bd-85c9-814112ab4474 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:59.409690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 109/221] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:59.416491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02074d-f3e2-4211-b7f8-5801afdc2dd5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.416803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02074d-f3e2-4211-b7f8-5801afdc2dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.417080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02074d-f3e2-4211-b7f8-5801afdc2dd5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.418631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 110/222] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:38:59.424441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02074d-f3e2-4211-b7f8-5801afdc2dd5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.440960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd42470-a90d-4caa-97d4-2e7ed247abee None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.465142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:59.479053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.480181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.480658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.481250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.493949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-26913bc7-475b-46e8-b447-d59323ec960e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:59.503390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:59.504258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:38:59.505070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:59.512578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 113/223] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:38:59.514263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.515025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.515522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.533400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:38:59.533573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02074d-f3e2-4211-b7f8-5801afdc2dd5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.535109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:38:59.577417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.578074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.578360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.578632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.579466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=6000d8e52e72416f86281ee22d344321) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:59.580273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:59.581780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:59.592831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 111/224] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/role_assignments?user.id=6000d8e52e72416f86281ee22d344321&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=75014435b442408ea67a373f2483e12c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:59.594411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.633693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 114/225] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:38:59.658245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:59.661095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.805242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e12ac-4b8a-473b-b0f0-c02d3e76b84a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.818115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:38:59.832507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b237b3-397e-4a3b-a621-bb8fe4e01893 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:38:59.851359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.852183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.852462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.852767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.872778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:38:59.875108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:38:59.875955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:38:59.876812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 115/226] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:38:59.882375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.890801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:38:59.891775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:38:59.892266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:38:59.892771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:38:59.893724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:38:59.894223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:38:59.895841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:38:59.917324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 112/227] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:38:59.923493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:38:59.993876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819f47-9288-4222-bf04-8f654ab3798a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.045218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:00.048783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a53b-7e5e-4fb5-bfa4-f6ebcb2887af None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.077657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.078187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.078472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.078746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.079580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:00.079811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.081245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.087245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.088392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.088895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.089378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.090398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 116/228] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:00.091099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.093393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.095786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:00.096005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 113/229] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:38:59 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:00.101530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:00.150416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:00.215379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e075352-53a6-47e1-98b2-6a858f7dccb2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.263806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.267437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.267986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.268585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.270844 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.273163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.276426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 114/230] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:00 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:00.284680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ab88c-0efe-4d9d-afa7-dfedce3f96e4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.286079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:00.338275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:00.352517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.353360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.353638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.353912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.360486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.362004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.363704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:00 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:00.369560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:00.458306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0654-caa1-4695-9023-4c529393121d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.521908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.523189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.523683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.524143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/eae865e50dcf48b18854706fe6a98370/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.530618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, user_id=eae865e50dcf48b18854706fe6a98370, role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.532348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.558923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 115/232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:00 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/eae865e50dcf48b18854706fe6a98370/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:39:00.564923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:00.572730 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73a58a-45ea-4ddf-aa5d-28614fc2c7d0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.627862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.628891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.629183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.629499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.633604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.635162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99f8e0-3388-4bd1-85e3-d1b771fdf061 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.637458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:00 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:00.643482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:00.761170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:00.770426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1c84a-f1d4-4856-96eb-1bfb65f399a2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:00.810686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:00.811651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:00.811929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:00.812193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/eae865e50dcf48b18854706fe6a98370/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:00.815548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, user_id=eae865e50dcf48b18854706fe6a98370, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:00.817385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db34279-616e-425e-af6e-357c2f084b8d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:00.841651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:00 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/eae865e50dcf48b18854706fe6a98370/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:01.127795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d224d9-3b5d-48e2-8a22-c3332d6a9a54 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.128173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d224d9-3b5d-48e2-8a22-c3332d6a9a54 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.128346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d224d9-3b5d-48e2-8a22-c3332d6a9a54 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.129776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:01.135128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ca84-9792-4e3b-b1e1-26a151f8f9e7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.135424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ca84-9792-4e3b-b1e1-26a151f8f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.135704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0ca84-9792-4e3b-b1e1-26a151f8f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.157042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0df0ca84-9792-4e3b-b1e1-26a151f8f9e7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:01.158274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0df0ca84-9792-4e3b-b1e1-26a151f8f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:01.240606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:01.264687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d224d9-3b5d-48e2-8a22-c3332d6a9a54 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:01.296695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5025-f24e-4751-8f7b-9da8d7652774 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.297223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5025-f24e-4751-8f7b-9da8d7652774 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.297223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5025-f24e-4751-8f7b-9da8d7652774 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.298853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 118/237] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:01.303772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.304053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.304332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.333039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:01.334253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:01.434410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d224d9-3b5d-48e2-8a22-c3332d6a9a54 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:01.449817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 119/238] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:01.485461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:01.486265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.486608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.486935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.501222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:01.509153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:01.510014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:01.510796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 120/239] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:01.517615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:01.528801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:01.534099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:01.591304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:01.695474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e4cbe-4a9e-4a79-9ce0-ef71117eb5ef None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:01.700595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a2eab-77fe-478f-b120-a1ee96c63675 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:01.744241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:01.745078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.745361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.745639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.749819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:01.752796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:01.754649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 121/240] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:01.759787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:01.767330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:01.768021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.768304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.768579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.769425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:01.769738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:01.771162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:01.799081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 120/241] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:01.805652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:01.861473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:01.867906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11fe43-c95f-4e9d-a452-2276e0d91c11 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:01.910149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:01.910824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:01.911104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:01.911374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:01.912098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:01.913582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:01.947740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 122/242] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:01 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:01.952172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.010756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3f06e-43f4-4e47-bf72-0fd3ce045356 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.064513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.065497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.065778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.066394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] PATH_INFO: `/v3/users/36f47f69a5d5432f89318334dabb6721` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.085527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] RBAC: Authorizing `identity:get_user(user_id=36f47f69a5d5432f89318334dabb6721)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.087070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe73c7-d213-4618-9307-ee5a0be8ab56 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.089156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 121/243] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:01 2022] GET /identity/v3/users/36f47f69a5d5432f89318334dabb6721 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:02.097900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.106332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e777f-2ac4-44c0-8b05-8578cd9d1ce1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.106910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e777f-2ac4-44c0-8b05-8578cd9d1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.107405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e777f-2ac4-44c0-8b05-8578cd9d1ce1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.109093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 122/244] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:02.115311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.115929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.116402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.137325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:02.138905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:02.226942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 123/245] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:02.230407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e5252-d526-4919-bf46-1bdea1728c97 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.252895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.271942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.272612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.272922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.273257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.304058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.332214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.384826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.387506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.390217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c419f-f130-4ad4-9d82-2ea3487ca4e0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.438068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.439241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.439723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.440196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.452976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:02.461164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:02.462028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:02.462887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:02.470487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 124/246] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:02.471959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.526217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 123/247] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:02.531770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.590458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.610997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2357ab3-d0d9-40b4-864b-b2f26074d7d3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.638665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.655173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d87e7a-06e8-4556-88c9-e8ac6eac2776 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.661364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.662289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.662736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.663171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.664185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:02.664660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.666478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.678656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 125/248] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:02.685506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.701543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.702946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.703444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.703905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.705432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.707105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.709419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 124/249] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:02.715645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.818661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e48504-2f6b-4ed7-aa3a-b31fe2fb4886 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.847787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dc947-a8d3-41f0-9eb7-aede5a6525f7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:02.871955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.873266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.874164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.876110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] PATH_INFO: `/v3/users/6000d8e52e72416f86281ee22d344321` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.878498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=6000d8e52e72416f86281ee22d344321)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.881314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.883408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 126/250] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/users/6000d8e52e72416f86281ee22d344321 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:02.887934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:02.891963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:02.924296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:02.925354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:02.925837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:02.926347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:02.927428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=36f47f69a5d5432f89318334dabb6721) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:02.927965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:02.930603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:02.943456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 125/251] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/role_assignments?user.id=36f47f69a5d5432f89318334dabb6721&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:02.976377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:03.059063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f870-2e48-4cce-a158-73b42b931bb8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:03.111858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:03.112772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.113062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.113339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.114635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:03.116190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648833d-565f-4909-92f1-e76c5843d09e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:03.118490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 127/252] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:02 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:03.125176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:03.255791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23454f8-1143-4dbe-b333-3ff203928aff None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.256178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23454f8-1143-4dbe-b333-3ff203928aff None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.256375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23454f8-1143-4dbe-b333-3ff203928aff None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.258031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 128/253] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:03.259133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9462b-661d-43fa-a3be-d7ca688e757d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:03.266823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.267129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.267391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.298694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:03.299994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.300492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.301017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/6000d8e52e72416f86281ee22d344321/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.304087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, user_id=6000d8e52e72416f86281ee22d344321, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:03.305600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a720cf-3a9a-4210-9606-b819344db826 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:03.316820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:03.318099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:03.322522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 126/254] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:03 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/6000d8e52e72416f86281ee22d344321/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:03.330862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e895-cd62-4748-8924-1d683a01c9d3 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.331213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e895-cd62-4748-8924-1d683a01c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.331566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e895-cd62-4748-8924-1d683a01c9d3 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.333090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 127/255] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:03.343612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.343902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.344313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.377902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:03.379156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:03.449231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:03.490306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 128/256] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:03.493108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 129/257] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:03.526486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:03.527253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:03.611973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:03.678459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9039b08-de8d-4476-bef6-0169e5410418 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:03.719642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e97a18-b818-4a0f-b4f0-e060030531eb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:03.724445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:03.725303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.725585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.725867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.747399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:03.762189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:03.763099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:03.763865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 130/258] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:03.781967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:03.782730 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.783012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.783286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.786266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:03.794708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:03.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:03.805085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:03.807001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 129/259] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:03.811497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:03.849182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:03.916907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149e949-83f8-44e6-aefb-c380a2e8e7e3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:03.952551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:03.953408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:03.953681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:03.953957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:03.954876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:03.955191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:03.956589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:03.965560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 130/260] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:03.971238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:04.075099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285232ad-1248-4510-a001-2492b01f0fc8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:04.093178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:04.116002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690961f-0388-45b4-9f55-23da5e3abd43 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:04.126209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:04.127106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:04.127389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:04.127664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:04.129047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:04.130409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:04.132262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 131/261] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:03 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:04.137601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:04.140497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:04.214063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:04.214767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:04.215052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:04.215332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:04.216101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:04.216411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:04.218544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:04.238734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 131/262] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:04.244880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:04.323245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccdf42-6e67-4360-9436-c495fde21a60 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:04.387612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:04.388660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:04.389162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:04.389792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:04.432432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85bef3-7a40-4c81-99bf-25d508f9290e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:04.457052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:04.490166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:04.491059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:04.491341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:04.491613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] PATH_INFO: `/v3/users/eae865e50dcf48b18854706fe6a98370` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:04.492934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] RBAC: Authorizing `identity:get_user(user_id=eae865e50dcf48b18854706fe6a98370)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:04.494694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:04.496360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 132/263] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:04 2022] GET /identity/v3/users/eae865e50dcf48b18854706fe6a98370 => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:04.506104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:04.541318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:04.542802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:04.569864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:04.688768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558179-2aa2-41c8-bebc-77e3a1c0dd29 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:04.761449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:04.762494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:04.762787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:04.763067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:04.807187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 132/264] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:04.813737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:04.874520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:04.876427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:04.946765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:04.959683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:05.043795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae8054-ee59-4c5b-a6ca-5cd98f945839 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.079951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 133/265] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:05.086338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:05.113086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:05.114321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.114893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.115363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.121511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:05.123002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:05.125217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 133/266] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:04 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:05.136743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:05.251230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21e9ed-37a3-4feb-b5d3-d2a752332d0b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.304762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:05.305659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.306325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.306612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.309519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:05.311273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:05.314772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 134/267] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:05 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:05.322191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329602-5a6a-47e4-a956-e100b646d4f1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.323278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:05.329443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:05.383955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:05.397962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:05.398644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.398928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.399203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.400054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=eae865e50dcf48b18854706fe6a98370) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:05.400369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:05.401867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d84ba-081b-4b73-be5f-b934a8053933 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:05.412273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 134/268] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:05 2022] GET /identity/v3/role_assignments?user.id=eae865e50dcf48b18854706fe6a98370&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:05.468221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cddf-89ee-405b-bcea-b10089854995 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.468546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cddf-89ee-405b-bcea-b10089854995 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.468802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504cddf-89ee-405b-bcea-b10089854995 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.470234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 135/269] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:05.475766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.476051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.476328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.508260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:05.509435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:05.527107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380b039-c532-4f78-ae79-f2854e53ff83 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.604009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:05.604683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.604989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.605260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.606149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=eae865e50dcf48b18854706fe6a98370) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:05.606429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:05.607912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:05.616959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 135/270] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:05 2022] GET /identity/v3/role_assignments?user.id=eae865e50dcf48b18854706fe6a98370&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:05.640873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 136/271] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:05.661946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:05.762056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:05.803425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde6104-5814-4731-8334-35fee4bb87c3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.842434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:05.843338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.843630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.843908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.856421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-6aad80e0-54f8-43ad-8916-26068e0b344c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:05.864936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:05.865893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:05.866659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 136/272] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:05.872416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:05.951326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575f21-fd60-4561-9434-1ddf42e4dd7d None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.952012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575f21-fd60-4561-9434-1ddf42e4dd7d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.952503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24575f21-fd60-4561-9434-1ddf42e4dd7d None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.955312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 137/273] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:05.959430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:05.960008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:05.960481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:05.982762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446409f9-49f2-41c0-a801-c2daf0d45ab8 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:05.990534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:05.991894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:06.018174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.028878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.029550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.029821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.030292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.030913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:06.031219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.032600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c3eca-d009-4503-9e59-13026a60e780 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.042708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 137/274] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.043785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407a89-0d70-4aee-a96a-a2acf0c56a1d None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.044069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407a89-0d70-4aee-a96a-a2acf0c56a1d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.044339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92407a89-0d70-4aee-a96a-a2acf0c56a1d None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.047490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 138/275] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:06.053332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.053619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.053894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.071092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:06.072275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:06.080423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 138/276] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:06.085101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.144243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.149469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 139/277] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:06.150475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.196958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f7a0-bb95-42f2-838b-21eb1acb13c4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.236612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.237547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.237833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.238109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] PATH_INFO: `/v3/users/536ba877c426444fa042b8a330a8a343` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.252556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] RBAC: Authorizing `identity:get_user(user_id=536ba877c426444fa042b8a330a8a343)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.254206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.260641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 139/278] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/users/536ba877c426444fa042b8a330a8a343 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.260641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.268843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ae404-192d-4a94-8148-65ca293b955f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.287569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.306789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.307565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.307834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.308307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.309282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.310755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.312909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 140/279] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.318319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.363748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f392d-9da2-45fd-a252-49778651892e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.381475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.400902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.402071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.402355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.402928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.413531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:06.421480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:06.422523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:06.423317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 140/280] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:06.424202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.430299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b47da-e74a-4d8f-becb-263166d0c482 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.465726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.466384 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.466663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.466936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.467844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, user.id=536ba877c426444fa042b8a330a8a343, scope.system=all) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:06.468336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.469811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.474891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 141/281] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/role_assignments?user.id=536ba877c426444fa042b8a330a8a343&scope.system=all&role.id=75014435b442408ea67a373f2483e12c => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.475665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.531843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.549469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccc6c-0587-4df9-98b9-fee99eb6652d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.588446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.589176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.589459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.589732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.590462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.591977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5721-7d50-434d-819f-bf2f76e9ec58 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.594457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41746119-f816-4e22-959f-25f0867465c5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.615501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 141/282] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:06 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:06.626419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e3e7-a49c-4eb5-bf99-f04f868f6b5a None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.626777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e3e7-a49c-4eb5-bf99-f04f868f6b5a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.626987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e3e7-a49c-4eb5-bf99-f04f868f6b5a None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.628620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 142/283] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:06.634782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.635898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.636180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.641487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.642173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.642459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.642733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.643519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:06.643829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.645327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.655506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 142/284] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.657644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:06.658513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:06.661789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.694221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.743703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 143/285] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:06.769434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.773688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5f11e-4a08-4305-bea4-5ca535300313 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.788969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:06.813775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.814681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.815028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.815382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] PATH_INFO: `/v3/users/36f47f69a5d5432f89318334dabb6721` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.817244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] RBAC: Authorizing `identity:get_user(user_id=36f47f69a5d5432f89318334dabb6721)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:06.818882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:06.820803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 143/286] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/users/36f47f69a5d5432f89318334dabb6721 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:06.826194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:06.897880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69ca35-43bf-485c-b613-60f7f637161d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.944230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:06.945148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:06.945435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:06.945707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:06.954532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c4b8a-ecf3-4a4c-809b-6b9acdac5b34 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:06.962548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:06.972042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:06.973033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:06.973813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:06.978257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 144/287] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:06.979695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.009499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.010735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.011211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.011673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.011960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:07.013916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.015813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.018087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 144/288] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:07.024199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.088762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:07.115296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a44bc5-f43a-416c-b1ce-d8627624b72a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:07.151402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919175ee-37a7-4802-a6d5-deab0f897f6a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:07.158195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.158876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.159155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.159427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.160185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:07.160497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.161931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.171011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 145/289] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:07.177882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.215874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.218322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.219707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.220226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/36f47f69a5d5432f89318334dabb6721/roles/3bebcbcd0d06486aa916e0054e57b2b5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.225739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, user_id=36f47f69a5d5432f89318334dabb6721, role_id=3bebcbcd0d06486aa916e0054e57b2b5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.227430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.259008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 145/290] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:07 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/users/36f47f69a5d5432f89318334dabb6721/roles/3bebcbcd0d06486aa916e0054e57b2b5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:07.322634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:07.347066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dbc92-ad47-4665-9434-1b97136ab4c1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:07.402014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.403280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.403806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.404278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] PATH_INFO: `/v3/users/6000d8e52e72416f86281ee22d344321` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.409620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] RBAC: Authorizing `identity:get_user(user_id=6000d8e52e72416f86281ee22d344321)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.411441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.413865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 146/291] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:07 2022] GET /identity/v3/users/6000d8e52e72416f86281ee22d344321 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:07.419144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.556170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd805d8-07c1-40c1-8292-e560b58256b4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:07.566888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:07.598532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.599167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.599458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.599735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.675267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.676867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.784374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 146/292] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:07.789592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.895052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf6da-3aa5-4982-ac4d-5d9973a9ae99 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:07.931066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:07.931941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:07.932225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:07.932496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:07.933770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:07.935265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b979e-6fe4-4f9a-8aaa-9cc332502272 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:07.937467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 147/293] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:07 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:07.945840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:07.961076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:08.077905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287d26a-d070-449d-8e7f-c1aec7bac498 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:08.117480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:08.118145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:08.118424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:08.118696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:08.119531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=6000d8e52e72416f86281ee22d344321) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:08.119841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:08.121359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac6670-e390-4c6c-b9b5-c2b9fdb8c8e7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:08.127391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 147/294] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:07 2022] GET /identity/v3/role_assignments?user.id=6000d8e52e72416f86281ee22d344321&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=75014435b442408ea67a373f2483e12c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:08.730406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba93e-fdc0-4a2f-baf0-f60a79f8a7c2 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:08.730738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba93e-fdc0-4a2f-baf0-f60a79f8a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:08.730958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ba93e-fdc0-4a2f-baf0-f60a79f8a7c2 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:08.732606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 148/295] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:08.738185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:08.738657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:08.738974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:08.762177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:08.763411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:08.836534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 148/296] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:08.858780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba93e-fdc0-4a2f-baf0-f60a79f8a7c2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:08.882152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:08.975112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ba93e-fdc0-4a2f-baf0-f60a79f8a7c2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.015312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.016059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.016347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.016630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.029122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:09.037258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:09.038094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:09.039150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 149/297] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:09.046380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.048852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.149609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea4a06-788d-4877-89f2-14dec81f8c23 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.188395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.189156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.189439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.189710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.190471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:09.190778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.192483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d54af5-a8b8-474d-9cc0-4ce2297a1ef9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.201616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 149/298] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:09.207456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.250279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5114a8-5868-4dac-ac6c-13a18d185cda None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.250907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5114a8-5868-4dac-ac6c-13a18d185cda None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.251371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5114a8-5868-4dac-ac6c-13a18d185cda None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.253223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 150/299] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:09.258630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5097-df33-4c12-bf27-b368a79e8c62 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.259251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5097-df33-4c12-bf27-b368a79e8c62 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.259710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5097-df33-4c12-bf27-b368a79e8c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.278208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-0c5a5097-df33-4c12-bf27-b368a79e8c62 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:09.279856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0c5a5097-df33-4c12-bf27-b368a79e8c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:09.294218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.315322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0ac8-9b39-406e-bb00-028af4b8d42d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.347194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.355425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.356319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.356592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.356915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] PATH_INFO: `/v3/users/536ba877c426444fa042b8a330a8a343` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.358479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] RBAC: Authorizing `identity:get_user(user_id=536ba877c426444fa042b8a330a8a343)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.359956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.365625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 150/300] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/users/536ba877c426444fa042b8a330a8a343 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:09.365747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 151/301] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:09.369636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.382022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba22e0-827b-47af-a2e3-1eb1f1eb2439 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.382340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba22e0-827b-47af-a2e3-1eb1f1eb2439 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.382556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba22e0-827b-47af-a2e3-1eb1f1eb2439 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.384281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 152/302] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:09.389251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.389584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.389864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.406462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:09.407507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:09.479739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 153/303] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:09.480966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.481098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc068e-1df7-480b-97bc-8b96200b7835 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.523940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.525198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.525685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.526188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] PATH_INFO: `/v3/system/users/536ba877c426444fa042b8a330a8a343/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.527898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=536ba877c426444fa042b8a330a8a343, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.529588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.539875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 151/304] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Jun 20 14:39:09 2022] PUT /identity/v3/system/users/536ba877c426444fa042b8a330a8a343/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:09.541615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.575058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.598160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e94723-a428-4853-ac79-97d10b46c701 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.630464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.643368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.644247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.644533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.644854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.658570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:09.667212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:09.668169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:09.669486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 154/305] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:09.674675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.693012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6c71b-04ec-4286-b9e6-ea74add90949 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.733175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.733988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.734265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.734526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.736101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.737679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a7a1d-b3e3-4ca1-b581-54bf65a2e473 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.743904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 152/306] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:09.743904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bb80-190f-4836-a7b2-c771bcaac685 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.743904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bb80-190f-4836-a7b2-c771bcaac685 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.743904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8bb80-190f-4836-a7b2-c771bcaac685 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.743904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 153/307] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:09.744742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8bb80-190f-4836-a7b2-c771bcaac685 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.791627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21d73d-ecee-4b88-8d63-a0603164521c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.826419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.827197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.827606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.827839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.828660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:09.829013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.830396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41d5e6-8fa7-4521-8b39-1c2601267459 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.832556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.839058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 155/308] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:09.840296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.840583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.840890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.857674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:09.859237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:09.859826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8bb80-190f-4836-a7b2-c771bcaac685 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:09.897077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:09.897751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:09.898034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:09.898308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] PATH_INFO: `/v3/groups` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:09.899004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:09.900594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:09.901808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:09.916457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 154/309] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Jun 20 14:39:09 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:09.925998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:09.936983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 156/310] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:09.962872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.047150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac0e64-8511-4130-9f9a-1487bb58a2a1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.085315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.086504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.086961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.087458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] PATH_INFO: `/v3/users/c0ecebf5a124429fb26b1db7735da150` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.089446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac88a8-5e73-4130-87a6-6ba60b97d9fc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.100531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.104916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] RBAC: Authorizing `identity:get_user(user_id=c0ecebf5a124429fb26b1db7735da150)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:10.107361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:10.109623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 155/311] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/users/c0ecebf5a124429fb26b1db7735da150 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:10.115296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.142077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.142280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.142502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.142709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.154261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:10.162589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:10.163476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:10.164249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:10.168662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 157/312] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:10.169812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.213078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.247577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92907ce0-4342-4fd8-aab0-6f729cc5b31b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.283930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.284689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.285247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.285381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.286278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, user.id=c0ecebf5a124429fb26b1db7735da150, scope.system=all) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:10.286635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:10.288226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:10.298642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 156/313] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jun 20 14:39:10 2022] GET /identity/v3/role_assignments?user.id=c0ecebf5a124429fb26b1db7735da150&scope.system=all&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:10.307226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3da1c9-b2ee-4fe1-8405-ab4f5c291bc8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.346857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.347878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.348367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.348874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.349830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:10.350320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:10.351931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:10.362507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 158/314] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:10.368389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.441518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.480874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602b07c-1e52-4d12-93c3-d99f2ab075a1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.515005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.515888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.516172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.516445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] PATH_INFO: `/v3/users/36f47f69a5d5432f89318334dabb6721` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.517705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] RBAC: Authorizing `identity:get_user(user_id=36f47f69a5d5432f89318334dabb6721)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:10.519175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:10.521155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 157/315] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:10 2022] GET /identity/v3/users/36f47f69a5d5432f89318334dabb6721 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:10.526440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.628005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.631917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de251a-92ba-40bf-be72-eea451c88f18 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.668286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.668993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.669281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.669559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.743269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:10.744754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:10.845024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.849671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 159/316] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:10.855427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:10.957822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044890b-a3db-495d-b5cf-1226ef153284 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:10.987989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:10.994486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:10.995624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:10.996083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:10.996555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:10.997954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:11.000086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf224cf-9a91-4031-b1ce-a4c0751f19b3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:11.002325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 158/317] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:10 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:11.008432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:11.110620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc0d47-b417-428c-ae40-d79d9ee3c816 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:11.147001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:11.147700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:11.147976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:11.148255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:11.149135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5, user.id=36f47f69a5d5432f89318334dabb6721) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:11.149450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:11.150905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc2112-0ead-4b59-b459-d62d44adb40e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:11.157994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 160/318] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:11 2022] GET /identity/v3/role_assignments?user.id=36f47f69a5d5432f89318334dabb6721&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:11.590439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910a6a-59cd-472e-9e6f-3c617a5d97af None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:11.590837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910a6a-59cd-472e-9e6f-3c617a5d97af None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:11.591009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33910a6a-59cd-472e-9e6f-3c617a5d97af None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:11.592591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 159/319] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:11.597705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:11.597957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:11.598265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:11.615549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:11.616762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:11.677109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:11.689014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 161/320] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:11.712584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910a6a-59cd-472e-9e6f-3c617a5d97af None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:11.816816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33910a6a-59cd-472e-9e6f-3c617a5d97af None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:11.853267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:11.853982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:11.854262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:11.854530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:11.865225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:11.873028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:11.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:11.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:11.876298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 160/321] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:11.880576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:11.988596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03436ba3-8f7d-479c-9ce9-ab8f720fd67a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.029752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94513375-895c-4c7a-b743-210c797517cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.030692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513375-895c-4c7a-b743-210c797517cd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.030692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513375-895c-4c7a-b743-210c797517cd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.030969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94513375-895c-4c7a-b743-210c797517cd None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.031734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94513375-895c-4c7a-b743-210c797517cd None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:12.032040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94513375-895c-4c7a-b743-210c797517cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.033459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94513375-895c-4c7a-b743-210c797517cd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.047568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 162/322] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:12.048882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.069279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dd9-a1e6-4e8f-b984-08babfbd8872 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.069803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dd9-a1e6-4e8f-b984-08babfbd8872 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.070064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9dd9-a1e6-4e8f-b984-08babfbd8872 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.071594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 163/323] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:12.076628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.077051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.077409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.094740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:12.095939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:12.116624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.149511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.164420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2cb4-e54f-495b-b457-601a281f7cee None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.169555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 164/324] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:12.193784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.202186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.203080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.203357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.203628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] PATH_INFO: `/v3/users/536ba877c426444fa042b8a330a8a343` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.204897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] RBAC: Authorizing `identity:get_user(user_id=536ba877c426444fa042b8a330a8a343)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.206383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.208034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 161/325] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/users/536ba877c426444fa042b8a330a8a343 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:12.214381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.310615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518ee94-1443-4cc0-97a3-1de3e75ba3dc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.325679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac61f4-a3e2-48af-b4aa-d666a294a920 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.346131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.346937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.347213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.347482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.348674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.350155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de867d2e-bfb5-4fee-ac4f-8d4ee26d73fb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.352057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 165/326] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:12.352154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.353056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb81b2-36a8-47c4-89d5-224c2be11ec9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.353337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb81b2-36a8-47c4-89d5-224c2be11ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.353627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb81b2-36a8-47c4-89d5-224c2be11ec9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.356754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 166/327] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:12.357243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb81b2-36a8-47c4-89d5-224c2be11ec9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.364418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.365109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.365392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.365665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.366504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] RBAC: Adding query filter params (role.id=75014435b442408ea67a373f2483e12c, user.id=536ba877c426444fa042b8a330a8a343, scope.system=all) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:12.366864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.368268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431052e7-c826-4cdd-90f6-410c6fb67333 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.380070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 162/328] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/role_assignments?user.id=536ba877c426444fa042b8a330a8a343&scope.system=all&role.id=75014435b442408ea67a373f2483e12c => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:12.381330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153928-0571-4497-956b-5415cab1249f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.381614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153928-0571-4497-956b-5415cab1249f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.381885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153928-0571-4497-956b-5415cab1249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.400936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-79153928-0571-4497-956b-5415cab1249f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:12.402192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-79153928-0571-4497-956b-5415cab1249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:12.419930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.483167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb81b2-36a8-47c4-89d5-224c2be11ec9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.490496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 163/329] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:12.513096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153928-0571-4497-956b-5415cab1249f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.521920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.522799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.522919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.523138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] PATH_INFO: `/v3/groups` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.523846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.525378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.544585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 167/330] 10.222.0.23 () {60 vars in 1134 bytes} [Mon Jun 20 14:39:12 2022] POST /identity/v3/groups => generated 226 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:39:12.643376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153928-0571-4497-956b-5415cab1249f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.659007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.680501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.681351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.681631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.681902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.693586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:12.701461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:12.702408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:12.703321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 164/331] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:12.709047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.810028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943aaeb3-a514-44f5-b0e3-a45158408dff None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:12.823729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:12.846541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:12.847214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:12.847491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:12.847759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:12.848508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:12.848844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:12.850212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:12.860004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 168/332] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:12.865245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:12.982312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72cbbb-340b-4fca-8959-b31488dcb144 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:13.019425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:13.020318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:13.020601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:13.023489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] PATH_INFO: `/v3/users/c0ecebf5a124429fb26b1db7735da150` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:13.026113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] RBAC: Authorizing `identity:get_user(user_id=c0ecebf5a124429fb26b1db7735da150)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:13.027614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35005ad-11e6-4531-a604-3d0440751acd None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:13.029622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 165/333] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:12 2022] GET /identity/v3/users/c0ecebf5a124429fb26b1db7735da150 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:13.035109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:13.141230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2367ea-59af-4b4a-a371-ae82c1bfa9c8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:13.175951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:13.176849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:13.177167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:13.177439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] PATH_INFO: `/v3/system/users/c0ecebf5a124429fb26b1db7735da150/roles/3bebcbcd0d06486aa916e0054e57b2b5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:13.178947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0ecebf5a124429fb26b1db7735da150, role_id=3bebcbcd0d06486aa916e0054e57b2b5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:13.180336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0716fec-8c65-42ae-993f-8259b32e9d90 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:13.192489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 169/334] 10.222.0.23 () {58 vars in 1334 bytes} [Mon Jun 20 14:39:13 2022] PUT /identity/v3/system/users/c0ecebf5a124429fb26b1db7735da150/roles/3bebcbcd0d06486aa916e0054e57b2b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:14.808142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bde-5726-4179-8eb2-e9f046654afc None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:14.808656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bde-5726-4179-8eb2-e9f046654afc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:14.808656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e531bde-5726-4179-8eb2-e9f046654afc None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:14.810336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 166/335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:14.815963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:14.817120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:14.817571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:14.840812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:14.842354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:14.882012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:14.935630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 170/336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:14.979840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531bde-5726-4179-8eb2-e9f046654afc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:15.044950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:15.117687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e531bde-5726-4179-8eb2-e9f046654afc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:15.165715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:15.166823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.167275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.167718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.183440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:15.192066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:15.192955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:15.193750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:15.195790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 167/337] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:15.202140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:15.323697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffd730-ffc6-4470-851a-ecd7ec688ef7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:15.361761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:15.362691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.363116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.363557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.364460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:15.364942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:15.366457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975d0f4-6b3b-4483-9ca4-0232129d6a24 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:15.380445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 171/338] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:15.386141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:15.433262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaf61-7aea-4c0f-a0e4-fc485a2f08f2 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.433807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaf61-7aea-4c0f-a0e4-fc485a2f08f2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.434227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10eaf61-7aea-4c0f-a0e4-fc485a2f08f2 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.436081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 172/339] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:15.441194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.441951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.442369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.467526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:15.470559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:15.514533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:15.583314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:15.592739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbdd30-ba11-4291-9aae-f321b0e9c2a7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:15.596143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:15.622347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:15.658971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:15.659866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.660288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.660738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.772706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:15.774487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:15.775588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312c13b-cac8-4682-a1bc-7ddd69c68cf7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:15.831795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:15.833355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.833778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.834191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.856325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-bbdaabfc-2524-4473-a14f-28504eb31062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:15.866550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:15.867624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:15.868593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:15.870998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 174/341] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:15.872406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780051-356d-495e-8501-01f8fefae12e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.872859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780051-356d-495e-8501-01f8fefae12e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.873290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780051-356d-495e-8501-01f8fefae12e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.874997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 175/342] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:15.881091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:15.881558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:15.882033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:15.917705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:15.918968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:15.938469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:15.949493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 168/343] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:15.951306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:15.969111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.058183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 176/344] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:16.059404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.115015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17d54c-33ac-493c-9f6c-9d03e5ce0c33 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.160291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.161039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.161326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.161604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.162370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:16.162682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:16.164146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb20cc-b93a-48ec-8a4a-50651bab22cb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:16.175015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 169/345] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:16.177366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c896ec-0025-4803-8156-51f5e1556201 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.178139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c896ec-0025-4803-8156-51f5e1556201 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.178625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c896ec-0025-4803-8156-51f5e1556201 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.181051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 170/346] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:16.182091 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c896ec-0025-4803-8156-51f5e1556201 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.208039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e88fe9-bc26-4de7-86f6-4b1e72aa9d25 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.265269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.266156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.266434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.266699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.268001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:16.269496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:16.271511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 177/347] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:16.272358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.275386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.296534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.328464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c896ec-0025-4803-8156-51f5e1556201 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.382311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.383115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.383392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.383662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.395464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5d1153b1-6558-4dcb-97d8-5af85672fef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:16.403257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:16.404225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:16.405312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 171/348] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:16.406468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.406468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.406722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.407161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fb77-07f1-4350-8888-27a6bb74a6cc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.430403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:16.431832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:16.449627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.450764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.451500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.452034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.513067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 172/349] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:16.513977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.534409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:16.536272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:16.555077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.581779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.634654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf150b-c2f9-47f4-ac44-53364ef1df1b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.657566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 178/350] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:16.658827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.672794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.673661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.673939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.674207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.681528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:16.683317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264f943f-8fe2-4390-8014-bdf39aaa334a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:16.685073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 173/351] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:16.686347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601edf18-b0fb-4032-a99a-b9b97a80ffff None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.686627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601edf18-b0fb-4032-a99a-b9b97a80ffff None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.686899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601edf18-b0fb-4032-a99a-b9b97a80ffff None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.692395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 174/352] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:16.693236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601edf18-b0fb-4032-a99a-b9b97a80ffff None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.779190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8bed3-2144-4aa3-a91e-b8f95fd3bc13 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.807559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.810537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601edf18-b0fb-4032-a99a-b9b97a80ffff None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.829172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.829871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.830389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.830663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.831405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:16.832742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:16.835262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:16.837014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:16.848357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 179/353] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:16.849241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:16.851235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:16.852199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.852637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.853072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.866732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-79b7fbdc-c875-41af-9166-34655ae86d08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:16.873834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:16.874706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:16.875478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 175/354] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:16.877094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:16.877094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:16.877248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:16.896160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:16.898351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:16.989172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f97556-8b92-4b02-b9d8-77fbf8df32d5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:16.990065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 176/355] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:16.991421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.030966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.031852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.032134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.032407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.033778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.035859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.037812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 180/356] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.038409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.096695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.130475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b7ae-13dc-4565-b74a-648cd0cc8d5d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.143414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.163193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b422ec0-8216-47f8-80e1-279212a83448 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.178771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.179428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.179707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.179977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.180887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=75014435b442408ea67a373f2483e12c, scope.project.id=5ad0f178bf0142508558a86936961184) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:17.181201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.182650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.188616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 177/357] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:16 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=75014435b442408ea67a373f2483e12c => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.189477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.210540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.211487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.211763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.212032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] PATH_INFO: `/v3/users/c0ecebf5a124429fb26b1db7735da150` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.213365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] RBAC: Authorizing `identity:get_user(user_id=c0ecebf5a124429fb26b1db7735da150)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.214881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.216665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 181/358] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/users/c0ecebf5a124429fb26b1db7735da150 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.217667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.323091 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a79f44-9840-41bf-ba9c-2e11d4539bdd None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.348414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d26a02-c963-4edd-94df-26dd32290edd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.364059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.364649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.364959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.365231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.366181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:17.366288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.367660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.369220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.381113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 178/359] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.382070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.397439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.399911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.400192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.400464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.415573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-245506df-7d6c-4481-97e9-fa40730927d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:17.423991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:17.425046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:17.425834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:17.428851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 182/360] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:17.430065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.431519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89342c-82c2-4a26-bdc7-ca6ffccea198 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.431750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89342c-82c2-4a26-bdc7-ca6ffccea198 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.432123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89342c-82c2-4a26-bdc7-ca6ffccea198 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.434720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 183/361] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:17.435648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89342c-82c2-4a26-bdc7-ca6ffccea198 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.522962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2442fa9-8ff9-4a03-a148-27e34616b0c0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.566678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.568047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.568329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.568676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.569892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89342c-82c2-4a26-bdc7-ca6ffccea198 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.569999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.571586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.574507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 179/362] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.575251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.619853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.621411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.621702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.621985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.622847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] RBAC: Adding query filter params (role.id=3bebcbcd0d06486aa916e0054e57b2b5, user.id=c0ecebf5a124429fb26b1db7735da150, scope.system=all) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:17.623173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.624678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.639955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 184/363] 10.222.0.23 () {56 vars in 1308 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/role_assignments?user.id=c0ecebf5a124429fb26b1db7735da150&scope.system=all&role.id=3bebcbcd0d06486aa916e0054e57b2b5 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.641517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.699029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.721270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe51c2-fdc6-46a3-a5a3-517915afe432 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.723281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:17.767070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.767741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.768031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.768298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.796818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9775d-0d2a-48ae-9875-21d4a9e140fc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:17.837525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:17.838140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.838399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.838671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.839440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:17.839749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.841166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72129c2-f55f-409d-ac1f-55ca6e536f72 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.850065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 185/364] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:17.851183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:17.851507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:17.851738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:17.857145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:17.858689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:17.874210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:17.875606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:17.975974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 186/365] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:17.978035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.985070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 180/366] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:17.990454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:17.993016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.013222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.117904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6afa8-5c44-4a8e-885b-46b93ed26d50 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.129064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331d44d-861e-40a6-b9e4-dda5ea4ad8ac None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.164769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.165734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.166152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.166558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.167532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=5ad0f178bf0142508558a86936961184) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:18.167979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.169630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.173045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.173927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.174312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.174604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.176816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 187/367] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.177507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.263458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.265523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.267912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.311177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.326094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1afd6-f831-48e3-8b49-9947b60cdd4c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.372818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.373675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.373951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.374219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.376117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.377696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.379483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 188/368] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.380270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.407364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 181/369] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:18.408553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.517420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfbcb6-3d39-473e-ab0b-b8ad440c7370 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.547284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9065e3-7553-470d-aba1-224e35e01fe3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.549473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.557558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.558547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.558724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.558957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.573016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:18.581337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:18.582196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:18.582958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 189/370] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:18.583601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.593530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.595251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.595724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.596180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.598048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.600447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.603342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 182/371] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.604321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.616463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.726078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b502fe-6409-4570-a4e6-a0135c1bbf63 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.730384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53dbd3-abda-44f2-84a7-fc02f901eb29 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.767014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.768225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.768689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.769157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.770570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.772190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.774212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 190/372] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.775147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.789448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.790128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.790413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.790689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.791624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:18.791934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.794104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.806809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 183/373] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.807815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:18.849112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.875751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:18.899729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80aabf-067a-4062-8c56-91af018f3e42 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.944847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a8545-6c11-4497-b27c-c11a0f186401 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:18.950490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:18.951382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:18.951880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:18.952302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:18.953321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=75014435b442408ea67a373f2483e12c, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:18.953797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:18.955398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:18.962016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 191/374] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=75014435b442408ea67a373f2483e12c => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:18.963035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:19.000983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.001862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.002150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.002501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.005699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.007338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.009443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 184/375] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:19.021767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:19.082461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ed93-9a0e-4787-a219-93f8e70121f9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:19.120608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.121901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.122197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.122478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.137138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5dc09-4447-4eff-9818-24d3b9edcaaa None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:19.153125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:19.157203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:19.206088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.207169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.207849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.207954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.208125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.208398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.209278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:19.209590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.211357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.225349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 185/376] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:19 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:19.322723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 192/377] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:19.328666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:19.467840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86c626-b9fa-4ba7-9dac-5f63e1725302 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:19.508086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.509013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.509299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.509577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] PATH_INFO: `/v3/projects/995754b005f44c748381f029d2a25afd` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.510893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] RBAC: Authorizing `identity:get_project(project_id=995754b005f44c748381f029d2a25afd)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.512407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.514660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 186/378] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:19 2022] GET /identity/v3/projects/995754b005f44c748381f029d2a25afd => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:19.519954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:19.573638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:19.636562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28898fc-d211-45b2-bb50-2f0ab97eb6dc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:19.682487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.683626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.684061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.684468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] PATH_INFO: `/v3/groups/65edcafcce454c09bbd8c8b2ed108edf` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.697406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] RBAC: Authorizing `identity:get_group(group_id=65edcafcce454c09bbd8c8b2ed108edf)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.699080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fb905-6334-4e27-8b60-e07e8955c4f9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.701303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 193/379] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:19 2022] GET /identity/v3/groups/65edcafcce454c09bbd8c8b2ed108edf => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:19.707024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:19.755056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:19.807271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da185d-304e-4f5a-ab8b-ba444a849038 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.807626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da185d-304e-4f5a-ab8b-ba444a849038 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.807808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da185d-304e-4f5a-ab8b-ba444a849038 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.809361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 194/380] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:19.818752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.819036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.819311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.834124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932b87-4aa5-4176-9a06-a66afdaa9db1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:19.857902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:19.859136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:19.870532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:19.871195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:19.871478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:19.871757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:19.872593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] RBAC: Adding query filter params (group.id=65edcafcce454c09bbd8c8b2ed108edf, role.id=695e03655fc54138a800137878e15659, scope.project.id=995754b005f44c748381f029d2a25afd) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:19.872938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:19.874504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:19.880444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 187/381] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:19 2022] GET /identity/v3/role_assignments?group.id=65edcafcce454c09bbd8c8b2ed108edf&scope.project.id=995754b005f44c748381f029d2a25afd&role.id=695e03655fc54138a800137878e15659 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:19.980749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 195/382] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:20.013539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:20.122266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:20.129283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93be058-9761-410e-a0f9-925a377dbcc5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:20.165673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:20.166488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.166768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.167037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.178237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:20.186170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:20.187536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:20.188318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 188/383] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:20.195737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:20.259929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:20.328543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5258e-1698-4884-8918-c1c6f3009767 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:20.372115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:20.372874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.373095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.373367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.374150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:20.374453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:20.375823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:20.384974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 196/384] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:20.392056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:20.547503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64dc2f-bd93-48b6-b16e-bfe8a0282a16 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:20.589554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:20.590792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.591301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.591779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.593469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:20.595177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a329358-fb96-4e53-8d1a-79baac86f818 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:20.597088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 189/385] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:20 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:20.605366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:20.711201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51b37-5d1c-426d-87a8-8f634c98be65 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:20.718355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:20.753680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:20.754552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.754830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.755097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.756284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:20.757761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:20.759468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 197/386] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:20 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:20.765044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1d0d-2f32-469a-bd59-3a27e0218cf5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.765208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:20.765607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1d0d-2f32-469a-bd59-3a27e0218cf5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.766012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab1d0d-2f32-469a-bd59-3a27e0218cf5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.767439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 190/387] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:20.773679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.773964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.774246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.805489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:20.806703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:20.851286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:20.865774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076f3a8-abaa-44ec-ad63-7475596e6576 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:20.901213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:20.902200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:20.902487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:20.902765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/groups/72971b3f08f74c8fba355f126e765722/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:20.904806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, group_id=72971b3f08f74c8fba355f126e765722, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:20.906276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:20.921679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 198/388] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jun 20 14:39:20 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/groups/72971b3f08f74c8fba355f126e765722/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:39:20.974813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 191/389] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:21.011877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.060542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:21.166703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9de3d-fbaa-470f-bcf4-e112ab666370 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:21.202186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:21.203011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.203293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.203569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.214251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:21.222713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:21.223628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:21.224461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:21.228879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 199/390] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:21.230458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.377652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332319-fb58-4e69-837a-a74a06d53504 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:21.419731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:21.420447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.420802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.421037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.421787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:21.422088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:21.423475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe7e29-8829-457a-90ed-c11e9c18225c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:21.436055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 192/391] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:21.442683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.590499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:21.606219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc3a2-9214-4eb7-87f0-b2759fb285bb None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:21.640163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de527b-d760-45cc-b661-70b20fd5efb5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.640840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de527b-d760-45cc-b661-70b20fd5efb5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.642483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de527b-d760-45cc-b661-70b20fd5efb5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.646964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 193/392] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:21.654059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.654350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.654633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.658107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:21.659229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.659713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.660187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.665592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:21.666921 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:21.674564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 200/393] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:21 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:21.675473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.690928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:21.692475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:21.719979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:21.815046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 194/394] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:21.825986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa19a9-741c-44d9-9b1d-3d51131a4d3b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:21.858359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.862364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:21.862527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:21.862815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:21.863091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:21.864324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:21.868535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:21.868535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 201/395] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:21 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:21.880831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:21.940118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.000109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba0de3-93e0-4419-adc3-c64722ba1e0a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.030249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b0aa0-3893-46fb-97b7-32160862eff5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.047363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.048176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.048483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.049081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.060090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-195e2dac-781a-4db5-b7cc-00248360a26a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:22.068521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:22.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:22.070229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:22.074705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 195/396] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:22.075833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.076046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd4b8-a7ce-4c2b-bb95-ae2fecb02067 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.076283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd4b8-a7ce-4c2b-bb95-ae2fecb02067 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.076694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bd4b8-a7ce-4c2b-bb95-ae2fecb02067 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.077820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.078320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 196/397] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:22.078563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.079034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd4b8-a7ce-4c2b-bb95-ae2fecb02067 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.079306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184/groups/72971b3f08f74c8fba355f126e765722/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.081891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0f178bf0142508558a86936961184, group_id=72971b3f08f74c8fba355f126e765722, role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.083800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63f4da2-477f-47e9-afec-06f5a384019f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.093575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.109061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 202/398] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jun 20 14:39:21 2022] PUT /identity/v3/projects/5ad0f178bf0142508558a86936961184/groups/72971b3f08f74c8fba355f126e765722/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:39:22.109061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1393c76-6a96-42d0-a5ad-bf79d14bfd39 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.109061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1393c76-6a96-42d0-a5ad-bf79d14bfd39 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.109061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1393c76-6a96-42d0-a5ad-bf79d14bfd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.149404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d1393c76-6a96-42d0-a5ad-bf79d14bfd39 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:22.150855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d1393c76-6a96-42d0-a5ad-bf79d14bfd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:22.290919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 203/399] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:22.292268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c759-c99c-4e59-b7b7-b7d78cdec1a4 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.292557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c759-c99c-4e59-b7b7-b7d78cdec1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.293765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bd4b8-a7ce-4c2b-bb95-ae2fecb02067 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.297013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c759-c99c-4e59-b7b7-b7d78cdec1a4 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.298526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 204/400] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:22.306603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.306884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.307440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.329750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:22.331314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:22.343129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.344092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.344387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.344665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.345834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:22.346149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.348165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.361624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 197/401] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:22.362627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.364470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.409677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 205/402] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:22.416896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.455835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.497636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ff082-87bd-427f-9269-e9eaa5ec26c2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.533366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b06f5-cfbc-47cb-9512-0e883df1e383 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.545429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.546982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.547341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.547852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.562621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:22.572001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:22.573082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:22.574044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:22.576526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 198/403] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:22.577602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.578751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.579810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.580185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.580551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.582005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.583586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.585670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 206/404] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:22.586603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.606678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.700226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e9ce7-8dcd-4fb6-83e4-8b0822d4bd3d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.711428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7a8cb-dbff-478d-aea1-b83f20a48490 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.731423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.741696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.742827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.743296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.743740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.753186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.753954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.754316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.754639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.755458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:22.755880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.756539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:22.757360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:22.765309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:22.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:22.766976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:22.767566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 207/405] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:22.767566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.773038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 199/406] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:22.775828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.858512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:22.879359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fccd6a-3e51-464a-b2bf-8e9d5d3c7e75 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.888124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077b213-7346-42b3-9fd0-8cc335a7171a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:22.914959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.915931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.916210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.916508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.917855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.919349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.924985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:22.926030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 208/407] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:22.926221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:22.926646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:22.926894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.927211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:22.928545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:22.930429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:22.932564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 200/408] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:22.933485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:22.994147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.044113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411ea64-c252-4f3f-8e4c-26abb0c053ce None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.047636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab3549-867c-4e34-ba90-8a14b9677ea5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.081688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.082865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.083291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.083704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/groups/72971b3f08f74c8fba355f126e765722/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.085869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, group_id=72971b3f08f74c8fba355f126e765722, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.086782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.087447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.087729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.088000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.088195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.088766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:23.089077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.090423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.103793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 209/409] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:23.103793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.113200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 201/410] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jun 20 14:39:22 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/groups/72971b3f08f74c8fba355f126e765722/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:23.114332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.123868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.254628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d8eb0-35e5-443f-8d52-ad4ddc2a9882 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.275974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.302588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.304480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.304948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.305369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] PATH_INFO: `/v3/groups/65edcafcce454c09bbd8c8b2ed108edf` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.306918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] RBAC: Authorizing `identity:get_group(group_id=65edcafcce454c09bbd8c8b2ed108edf)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.308614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.312250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 202/411] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:23 2022] GET /identity/v3/groups/65edcafcce454c09bbd8c8b2ed108edf => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:23.319026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.333111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c06-b82d-49b6-96e8-6de3e36b36cd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.414456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.415371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.415651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.415918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.417499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.419059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.421772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 210/412] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:23 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:23.427404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.451096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84130c6c-b3b9-42da-88c1-f8eb3ddc8b1a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.495711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.496599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.496917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.497193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] PATH_INFO: `/v3/projects/995754b005f44c748381f029d2a25afd` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.499592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] RBAC: Authorizing `identity:get_project(project_id=995754b005f44c748381f029d2a25afd)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.501452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a17e18-9771-49e5-9acf-6b33ec74b9ac None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.503663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 203/413] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:23 2022] GET /identity/v3/projects/995754b005f44c748381f029d2a25afd => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:23.505482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240df6-62b4-4223-ba59-49f519d3f5bd None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.505714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240df6-62b4-4223-ba59-49f519d3f5bd None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.505996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c240df6-62b4-4223-ba59-49f519d3f5bd None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.510093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 204/414] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:23.515074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240df6-62b4-4223-ba59-49f519d3f5bd None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.530251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.558446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befb18e-99f8-4e52-a149-b3aa04290bf7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.574194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.607503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.609357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.609650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.609922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/groups/72971b3f08f74c8fba355f126e765722/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.612606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ab02f0a23a44a3eaae50c00cd331db5, group_id=72971b3f08f74c8fba355f126e765722, role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.614639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8fe39-8207-429b-927c-c7f7c50cd800 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.629019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c240df6-62b4-4223-ba59-49f519d3f5bd None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.633521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 211/415] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jun 20 14:39:23 2022] PUT /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5/groups/72971b3f08f74c8fba355f126e765722/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:23.634871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.635161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.635440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.667132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:23.667968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:23.727054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.727972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.728256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.728525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] PATH_INFO: `/v3/projects/995754b005f44c748381f029d2a25afd/groups/65edcafcce454c09bbd8c8b2ed108edf/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.732546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=995754b005f44c748381f029d2a25afd, group_id=65edcafcce454c09bbd8c8b2ed108edf, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:23.738175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:23.767465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 205/416] 10.222.0.23 () {58 vars in 1442 bytes} [Mon Jun 20 14:39:23 2022] PUT /identity/v3/projects/995754b005f44c748381f029d2a25afd/groups/65edcafcce454c09bbd8c8b2ed108edf/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:23.792539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 212/417] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:23.818402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:23.941687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4542cc-b95f-48fd-afc7-8c79b7db24a7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:23.955041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:23.978047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:23.978943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:23.979403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:23.979849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:23.990774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:23.998636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:23.999538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:24.000347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 206/418] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:24.008895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.081356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:24.118210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83410e83-e80c-419d-90f1-f82c119d9462 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:24.153875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:24.154552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.155049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.155326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.156080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:24.156381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:24.157880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77d489-1e5c-47a3-8a28-ea2b793a16b5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:24.168115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 213/419] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:24.176973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.277576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44226e-030d-4f56-84ab-b7f4f1edcbf3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:24.311063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:24.311715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.312024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.312295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.364150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:24.387904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100c08-ad4e-45d6-b195-45e1a04af610 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.388234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100c08-ad4e-45d6-b195-45e1a04af610 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.388455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed100c08-ad4e-45d6-b195-45e1a04af610 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.390577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 214/420] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:24.392798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:24.394511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:24.395341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.395621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.395942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.413610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:24.414963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:24.488741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 215/421] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:24.510032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.526115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 207/422] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:24.533985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.579087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:24.621280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903ca88-15ca-4d90-8636-33a24a3d9288 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:24.659367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:24.660184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.660461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.660744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.681028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:24.689227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:24.690092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:24.690857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:24.692227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 216/423] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:24.704206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.717118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:24.766819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738a42c-2498-425c-845d-c192d4b67eef None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:24.809905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f0f1b1-3774-4b84-a630-5f0c1e0de176 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:24.832015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:24.847419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:24.848092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.848369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.848639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.849420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:24.850037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:24.851478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:24.860610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 217/424] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:24.870392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:24.871273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:24.871563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:24.871837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:24.873075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:24.873827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:24.874747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:24.876651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 208/425] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:24.881771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.016012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9abae6-c671-4ca8-9c8b-fb51781bf7f5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.058443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb648e85-1270-4cfa-9dac-31ce79e4bb25 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.084433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:25.085068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.085385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.085764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.127285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:25.128153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.128438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.128739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.130931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:25.132407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:25.134086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 209/426] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:25.158037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.171325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:25.188226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:25.250003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:25.251897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:25.284923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f70ba9-bab6-4118-820b-959608b04335 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.328401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:25.329195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.329376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.329636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.330482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=75014435b442408ea67a373f2483e12c, scope.project.id=5ad0f178bf0142508558a86936961184) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:25.330794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:25.332259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:25.350954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 210/427] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:25 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=75014435b442408ea67a373f2483e12c => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:25.438749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 218/428] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:25.444591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.544621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:25.584222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffc821-7f7d-4d09-aaa2-d54c015a26b2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.628544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:25.629379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.629666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.629947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] PATH_INFO: `/v3/projects/5ad0f178bf0142508558a86936961184` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.631235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] RBAC: Authorizing `identity:get_project(project_id=5ad0f178bf0142508558a86936961184)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:25.632806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31531c50-08e9-4c8a-907f-3093123f08d4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:25.634864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 211/429] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:25 2022] GET /identity/v3/projects/5ad0f178bf0142508558a86936961184 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:25.641104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.664199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d4b2-d6ec-4419-a1f7-38bfe954a810 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.664510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d4b2-d6ec-4419-a1f7-38bfe954a810 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.664808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184d4b2-d6ec-4419-a1f7-38bfe954a810 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.666212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 212/430] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:25.671984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.672268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.672546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.709938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:25.711224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:25.765490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:25.796393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053eaa3d-79d4-4bd9-b4b6-83ec1940aa0e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.815784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 213/431] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:25.841450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.859481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:25.860372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:25.860923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:25.861254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:25.863813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:25.865355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:25.867379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 219/432] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:25 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:25.872760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:25.924347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:25.963547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4adb9-050c-4350-93d8-87d253f1aed0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:25.988043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8e122-34aa-4339-9c63-1c47ec368b47 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.004142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.005022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.005283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.005562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] PATH_INFO: `/v3/roles/member` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.017057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:26.030706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.031664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.032163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.032634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.033726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=5ad0f178bf0142508558a86936961184) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:26.034236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.035865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480fe45-3cbd-4799-bae1-956802e4f587 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:26.036110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:26.037020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:26.037804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 214/433] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:26.043573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.047772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 220/434] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:25 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=5ad0f178bf0142508558a86936961184&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:26.161915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c96f48-194a-49ab-b187-8fab594a8cda None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.197102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.202083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.202950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.203289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.203744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.204513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] RBAC: Adding query filter params (name=member) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:26.204853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.206308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.214343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260609-49e9-4fcf-a972-772534346c98 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.215461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260609-49e9-4fcf-a972-772534346c98 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.215943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c260609-49e9-4fcf-a972-772534346c98 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.216112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 215/435] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:26.218036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 221/436] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:26.221724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.223837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841376-814a-4985-8d9d-d90623c05187 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.224337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841376-814a-4985-8d9d-d90623c05187 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.224861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df841376-814a-4985-8d9d-d90623c05187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.256746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-df841376-814a-4985-8d9d-d90623c05187 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:26.257860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-df841376-814a-4985-8d9d-d90623c05187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:26.270975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.343685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c5fa0-80c2-4f22-a7b7-56f498f6d69e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.349949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 222/437] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:26.351120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49241a-a886-4161-90f2-a9f8af470122 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.351407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49241a-a886-4161-90f2-a9f8af470122 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.351678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49241a-a886-4161-90f2-a9f8af470122 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.352951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 223/438] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:26.359576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.359853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.360132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.384107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:26.385336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:26.387613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.393198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.393492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.393761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.456385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.461988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 224/439] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:26.463100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.476750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.480737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.545429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.571260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0251-d278-45e8-93bb-631bef74ce92 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.582858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 216/440] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 20 14:39:26.582858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.604457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.605295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.605571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.605837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.615849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:26.623797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:26.624646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:26.625472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 225/441] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:26.627121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.673966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.683333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6bc0d-b111-407f-81fa-c0de5fc5073a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.717382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.718096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.718374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.718639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.727588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e31496-44c2-4c66-8cee-8351f321a057 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.728432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:26.736048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:26.737111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 217/442] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:26.738237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.763670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.764515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.764826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.765096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.766313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.767772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.769512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 226/443] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:26.770266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.775397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.837837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132ecd-c659-4bf0-9d70-2ac181181430 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.869011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540debad-c0ea-4c9b-a533-87bf7f016049 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:26.870765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.871439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.871724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.871999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.872777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:26.873094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.874551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.882910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 218/444] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:26.883701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.901496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:26.902171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:26.902449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:26.902718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:26.903364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:26.903464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:26.903763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:26.905361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:26.914205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 227/445] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:26.915114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:26.977989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.004157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b857fc-e108-49da-8dcb-b7c86a56fac6 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.032181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01afc87f-f07e-45a2-adc5-b6e371fead16 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.044944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.045923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.046179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.046474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.047670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.049194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.050880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 219/446] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:27.051645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.070183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.070853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.071126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.071405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.135315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.138484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.140055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.153957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b436b11-8648-4ebe-8658-36a53b3135f1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.189083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.189717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.190019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.190290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.202189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.240813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 228/447] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:27.241604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.259804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.261321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.344147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1906b5c-5b77-4208-9b97-19350aaf8bdd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.347206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.367849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 220/448] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:27.368685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.378868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.379554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.379836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.380111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.380958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=75014435b442408ea67a373f2483e12c, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:27.381268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.382706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.388519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 229/449] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=75014435b442408ea67a373f2483e12c => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:27.389582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.423908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.497135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee3a93-62e3-4a4b-a7c0-657a5a2a2ccb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.507810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35587d-732b-496a-a9db-507dbffef88a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.536196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.537101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.537377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.537659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] PATH_INFO: `/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.539618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] RBAC: Authorizing `identity:get_project(project_id=1ab02f0a23a44a3eaae50c00cd331db5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.540337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.542101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 221/450] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/projects/1ab02f0a23a44a3eaae50c00cd331db5 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:27.548271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.548434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.549193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.549481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.550442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] PATH_INFO: `/v3/projects/995754b005f44c748381f029d2a25afd` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.550963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] RBAC: Authorizing `identity:get_project(project_id=995754b005f44c748381f029d2a25afd)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.552702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.554154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 230/451] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/projects/995754b005f44c748381f029d2a25afd => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:27.559710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.608407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.665131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e29c9a-5dd1-49bf-b7ce-e29028f0a68a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.685510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.694653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c5f5-b86d-48c4-9ae6-7e20851cdcca None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.713089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.714148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.714424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.715017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] PATH_INFO: `/v3/groups/72971b3f08f74c8fba355f126e765722` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.716358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] RBAC: Authorizing `identity:get_group(group_id=72971b3f08f74c8fba355f126e765722)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.718370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.720497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 222/452] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/groups/72971b3f08f74c8fba355f126e765722 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:27.726841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.731356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.732231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.732512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.732882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] PATH_INFO: `/v3/groups/65edcafcce454c09bbd8c8b2ed108edf` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.734350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] RBAC: Authorizing `identity:get_group(group_id=65edcafcce454c09bbd8c8b2ed108edf)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.735803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.737848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 231/453] 10.222.0.23 () {56 vars in 1180 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/groups/65edcafcce454c09bbd8c8b2ed108edf => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:27.743186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:27.831816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae05217-1395-4b74-95b1-94b93efca2e1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.841807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4ad06-c2b9-44e3-945d-7231e30a895b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:27.849328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:27.867827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.868495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.868789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.869061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.869896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] RBAC: Adding query filter params (group.id=72971b3f08f74c8fba355f126e765722, role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:27.870201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.871646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af817bd8-88ac-4bae-910b-32fdabf0cd28 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.877499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 223/454] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/role_assignments?group.id=72971b3f08f74c8fba355f126e765722&scope.project.id=1ab02f0a23a44a3eaae50c00cd331db5&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:27.877839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:27.878502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:27.878790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:27.879069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:27.879910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] RBAC: Adding query filter params (group.id=65edcafcce454c09bbd8c8b2ed108edf, role.id=695e03655fc54138a800137878e15659, scope.project.id=995754b005f44c748381f029d2a25afd) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:27.880228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:27.881711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a14622-9f04-4fb6-a977-70c60f91cd03 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:27.890634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 232/455] 10.222.0.23 () {56 vars in 1376 bytes} [Mon Jun 20 14:39:27 2022] GET /identity/v3/role_assignments?group.id=65edcafcce454c09bbd8c8b2ed108edf&scope.project.id=995754b005f44c748381f029d2a25afd&role.id=695e03655fc54138a800137878e15659 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:30.614535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8eacd-181e-4773-9f6d-f23a18532b2e None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.615089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8eacd-181e-4773-9f6d-f23a18532b2e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.615338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8eacd-181e-4773-9f6d-f23a18532b2e None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.616856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 224/456] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:30.622104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263249-85e4-40c1-8322-a161e0615427 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.622550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263249-85e4-40c1-8322-a161e0615427 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.622723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c263249-85e4-40c1-8322-a161e0615427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.649734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7c263249-85e4-40c1-8322-a161e0615427 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:30.650954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7c263249-85e4-40c1-8322-a161e0615427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:30.678939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:30.735570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 233/457] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:30.759259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8eacd-181e-4773-9f6d-f23a18532b2e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:30.806177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8475-e4fc-4ee3-816e-211c60116fb2 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.806506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8475-e4fc-4ee3-816e-211c60116fb2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.806732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d8475-e4fc-4ee3-816e-211c60116fb2 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.808366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 234/458] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:30.822158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6f10-0879-49e0-8f99-3fb53f5b961c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.822462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6f10-0879-49e0-8f99-3fb53f5b961c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.822741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a6f10-0879-49e0-8f99-3fb53f5b961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.854188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-587a6f10-0879-49e0-8f99-3fb53f5b961c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:30.855540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-587a6f10-0879-49e0-8f99-3fb53f5b961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:30.892504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8eacd-181e-4773-9f6d-f23a18532b2e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:30.930072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:30.931173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.931594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.932025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.944739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 235/459] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:30.944739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ec68-b859-4788-99fa-13fe545f5bda None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.944739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ec68-b859-4788-99fa-13fe545f5bda None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.944739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ec68-b859-4788-99fa-13fe545f5bda None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.944739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 236/460] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:30.948493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:30.948808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:30.949088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:30.954373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:30.955876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:30.974608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:30.976108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:30.983666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:30.984510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:30.985453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:30.985453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:30.985453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:30.985453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:30.985453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 225/461] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:30.990587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.036827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.068691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 237/462] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:31.069671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.088934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.107649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142015af-3eb6-45aa-94ca-a39a81ab8961 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.143676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.144850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.145344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.145834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.157172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.158655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:31.176473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:31.177513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:31.178328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:31.178328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:31.178328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.178328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:31.178545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de1afb-870a-41a0-b7a2-dce9feb360c0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.182568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 226/463] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:31.183411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.214575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.215253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.215543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.215802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.216548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:31.216885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.218968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d422ae9-a677-4c1a-9b4c-83bd05987e51 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.230265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 238/464] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:31.231526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f802-ac47-45d0-b1bd-351b0a6b7f4b None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.231811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f802-ac47-45d0-b1bd-351b0a6b7f4b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.232091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71f802-ac47-45d0-b1bd-351b0a6b7f4b None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.237438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 239/465] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:31.237438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71f802-ac47-45d0-b1bd-351b0a6b7f4b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.278024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.298795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2c95-369a-4c8c-9169-2d165c659782 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.323504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.336622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.337451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.337735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.338011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.347753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71f802-ac47-45d0-b1bd-351b0a6b7f4b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.349037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.350564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:31.368985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:31.369879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:31.370719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:31.370719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:31.370719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.370719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:31.370719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 227/466] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:31.371734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.389066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.389818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.390105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.390379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.391117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:31.391425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.392834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b61ce-a420-449e-8a27-e95f42297107 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.405527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 240/467] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:31.406397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.406680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.406952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.423725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:31.424945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:31.494695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 241/468] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:31.495489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.517112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21702f8-ecf4-4a7d-9504-ae7d15afa745 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.553802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.554462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.554744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.555013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.555717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.557202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.565876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.570882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.582891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 228/469] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:31 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:31.583599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.627845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8f966-1c4a-48b6-b239-c79eeaf6d6b4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.678677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.679849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.680793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.681417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.682545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:31.683002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.685209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.702754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 242/470] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:31.703899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.708673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d7a71-f51a-4372-9239-e1038de7435f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.751220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.751898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.752179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.752451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.753222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.754734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.779149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 229/471] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:31 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:31.780474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.850772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.856819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b98a6f-81ec-454b-bceb-ecac1a88cde5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.888392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:31.899052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.899558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.899850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.900111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.913176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.914685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:31.922671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266df5a7-71e1-4710-9d9f-9355568e87e7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-ae1e5639-5a20-4632-aa65-7d841f8f3dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:31.933752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:31.934649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:31.935462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:31.935462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:31.935462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:31.935462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:31.935462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 243/472] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:31.936423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d6dd-cdfb-4e8a-828c-a89be9f06b7f None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.936765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d6dd-cdfb-4e8a-828c-a89be9f06b7f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.937032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60d6dd-cdfb-4e8a-828c-a89be9f06b7f None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.938642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 244/473] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:31.943786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d6dd-cdfb-4e8a-828c-a89be9f06b7f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:31.973928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:31.974606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:31.975006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:31.975284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:31.976113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:31.977686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67c097-081e-4562-b237-cb13cce39e61 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:32.001356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 230/474] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:31 2022] POST /identity/v3/users => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:32.002737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.003015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.003290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.033561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:32.035843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:32.092004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60d6dd-cdfb-4e8a-828c-a89be9f06b7f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:32.119556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 231/475] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:32.153049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:32.155710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:32.156454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.156771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.157030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.157843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:32.158147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:32.159571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:32.181802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 245/476] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:32.187364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:32.197980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:32.243841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:32.273705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0de43f-4843-4d70-9d66-5dfd9687c65d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:32.306709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5366b-2b01-4176-8806-2de4d0071771 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:32.309627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:32.310399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.310685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.310993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.311759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:32.313198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:32.321831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.sql.core [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 14:39:32.321831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 14:39:32.321831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [parameters: {'id': '687d2e998531486d9b5f90c5b0a217cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 14:39:32.321831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86687) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result.read() Jun 20 14:39:32.340433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return ref.to_dict() Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:39:32.341377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application yield resource Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise self.value Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application session.commit() Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 14:39:32.342314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.session.flush() Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application compat.raise_( Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 14:39:32.343251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:39:32.344110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result.read() Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:39:32.346190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [parameters: {'id': '687d2e998531486d9b5f90c5b0a217cb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:32.348026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 20 14:39:32.351161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.353218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 232/477] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jun 20 14:39:32 2022] POST /identity/v3/roles => generated 144 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:32.353218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:32.362807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:32.363500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.363780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.364051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.364816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:32.366264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:32.406961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 246/478] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:32 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:32.522591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:32.525628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8aff1-6934-4ad9-bc9f-a6012f877339 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:32.581832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:32.582662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.582945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.583222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.594589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0c59a741-b009-4003-8de8-6a0a17f4c07b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:32.602797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:32.603680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:32.604657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 233/479] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:39:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:32.609800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:32.711807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:32.719379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d7c0b-bfc7-4495-9e4a-37d5a991356f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:32.756247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:32.756957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:32.757241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:32.757513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:32.758321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:32.758631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:32.760002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555fddc-78bc-4795-bd9b-d9f23ed9ee60 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:32.768946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 247/480] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:34.081524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd06fb-ff05-4d03-9e28-208d7162b2f5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.082513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd06fb-ff05-4d03-9e28-208d7162b2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.082983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd06fb-ff05-4d03-9e28-208d7162b2f5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.084817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 234/481] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:34.089747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8151-44b6-4025-8e43-901ed43486de None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.090554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8151-44b6-4025-8e43-901ed43486de None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.091038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8151-44b6-4025-8e43-901ed43486de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.113039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-520f8151-44b6-4025-8e43-901ed43486de None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:34.114563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-520f8151-44b6-4025-8e43-901ed43486de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:34.204403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 248/482] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:34.223451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edfe9b-26f0-4545-b47a-1d03a8500cd2 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.224034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edfe9b-26f0-4545-b47a-1d03a8500cd2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.224505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edfe9b-26f0-4545-b47a-1d03a8500cd2 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.226108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 235/483] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:34.234650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8151-44b6-4025-8e43-901ed43486de None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.239068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.239348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.239621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.268291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:34.269513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:34.369159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:34.380089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 236/484] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:34.391309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8151-44b6-4025-8e43-901ed43486de None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:34.415010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.430164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:34.430977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.431257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.431531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.455015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:34.462781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:34.463634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:34.464413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 249/485] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:34.474877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.591626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:34.621452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a26be4-fb40-4cc5-b156-6ce131e8230d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:34.637191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a67feb-0a0b-4232-b2f2-eb1cf5b45c7c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:34.689518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:34.690187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.690464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.690731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.692406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:34.692738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:34.694120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc4a93-dd28-4c63-a3a2-f5768b86b264 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:34.702878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:34.703773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.704112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.704379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.710697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 250/486] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:34.712523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f990c9-06c9-4e51-bf4c-1282f75fae71 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.712828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f990c9-06c9-4e51-bf4c-1282f75fae71 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.713239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f990c9-06c9-4e51-bf4c-1282f75fae71 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.717122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 251/487] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:34.719906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f990c9-06c9-4e51-bf4c-1282f75fae71 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.721555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-a8258766-89d9-4846-a9e3-a2d69d116016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:34.732348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:34.733363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:34.734587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 237/488] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:34.735644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.735788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.736815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.744341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:34.760188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:34.761802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:34.852737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 238/489] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:34.852737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.867315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f990c9-06c9-4e51-bf4c-1282f75fae71 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:34.914032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:34.914838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:34.915184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:34.915518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:34.927817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:34.929423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:34.948192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:34.950072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:34.951158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:34.952276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:34.952276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:34.952276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:34.952276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:34.958244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 252/490] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:34.958244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:34.977226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24825a9d-070e-4fa7-945c-9cad070b25a7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.015383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.016147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.016489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.016936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.017754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:35.018118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.019572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.028238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 239/491] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:35.029246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.034605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.074467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1fa69-f0a5-48b6-a2fc-d17482c1f4d4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.112200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.113030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.113309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.113609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.125271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-a559e799-3c42-46ea-a569-d1047fb2a05e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:35.133586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.134467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:35.135259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:35.135854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0acb-5796-49ba-b6fd-46caf2561ce2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.139772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 253/492] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.141235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e675-64e7-4538-b978-9a84ebb41f2e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.141516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e675-64e7-4538-b978-9a84ebb41f2e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.141783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e675-64e7-4538-b978-9a84ebb41f2e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.144839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 254/493] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:35.144839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e675-64e7-4538-b978-9a84ebb41f2e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.173616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.174248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.174537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.174810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.175544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:35.175851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.177310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.201019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 240/494] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:35.201019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.201019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.267667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e675-64e7-4538-b978-9a84ebb41f2e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.291234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.307210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.308063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.308340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.308608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.309439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f11ce-1d46-45c3-9961-ec2d45300ef7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.320149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.321322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d047e59a-fbb1-4e0a-9b23-0a3572003ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:35.338927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.339778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.340613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:35.340613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:35.340613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:35.340613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:35.340613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 255/495] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.341733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.341733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.341885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.352855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.354174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.354898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.355386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.356339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:35.356895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.358586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.358794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:35.359975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:35.369174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 241/496] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:35.370590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.431901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 256/497] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:35.433138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.459105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.491251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b61e2f-0a28-46f1-981e-35847a590253 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.527510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.528305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.528583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.528884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.536303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.537812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.543806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc3f4b-6b6a-4de1-8769-4048b2726731 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.546332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:35.554014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.555016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:35.555875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:35.557021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 242/498] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.557948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.579480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.580390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.580668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.580965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.581684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:35.581982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.583356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.595239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 257/499] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:35.596040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.660044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f0fe-65d2-478e-821b-dd4307faee26 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.682439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.693777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235efe5a-9920-4496-8de0-ca5e5d6c863f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.695532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.696332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.696615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.696921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.708698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.710215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-27c0262b-f107-4bb2-85ad-255ac55f68ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:35.727558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.728396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.729451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:35.729451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:35.729451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:35.729451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:35.729668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.729668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.729806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 243/500] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.729870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.729870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.730070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5bce-31f1-448c-aa78-540abbfddb54 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.730355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5bce-31f1-448c-aa78-540abbfddb54 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.730631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d5bce-31f1-448c-aa78-540abbfddb54 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.732042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 244/501] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:35.732751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5bce-31f1-448c-aa78-540abbfddb54 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.741554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:35.749410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.750331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:35.751109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:35.751899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 258/502] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.752907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.778624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:35.840887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d5bce-31f1-448c-aa78-540abbfddb54 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.851020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de2d5b-d297-46ca-ba6d-acaef54c01d6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:35.877654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.878329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.878612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.878881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.879720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:35.880032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.881516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d1b72e-48e4-46a2-981b-94b4c7afa21a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.884969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:35.885754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.886028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.886298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.894382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:35.895833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:35.911126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 259/503] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:35.913154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:35.918712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 245/504] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:35.919885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:35.920291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:35.920575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:35.937183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:35.938311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:35.965834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.001533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.007848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 246/505] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:36.007848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.031025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5650-a337-46f1-8df0-89eb9347586e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.065804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.066886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.067216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.067580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.068308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:36.068609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.070024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.081824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 260/506] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:36.082614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.110666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043dd2b9-92c8-405d-9858-55fbd4cdb4c7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.145072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.145718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.145996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.146288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.147030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:36.147333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.148745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.156588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 247/507] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:36.157409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.180601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06f983-bd08-4058-b77a-f0463b4d8e35 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.184704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.215049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.215650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.215933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.216208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.217528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:36.217846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.219289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.256971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 261/508] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:36.257805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.258389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c356b-2c3f-4d2c-8027-02e238cc7f75 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.260392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.296117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.296790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.297070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.297340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.359603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea63f8-9ceb-4c48-a754-10da95b29c00 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.365056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.366535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.392970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.393363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.394172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.394670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.394961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.405744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.407238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:36.425346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:36.426221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:36.427040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:36.427040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:36.427040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.427040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:36.427040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 262/509] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:36.427298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.474241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 248/510] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:36.475006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.481347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.527280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fb5ec-7424-4c0b-9719-f13eefbde213 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.561550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.562351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.562636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.562908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.570607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.571814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff48e48-d486-4290-b745-d35450741c11 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.572078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:36.586191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:36.587114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:36.588021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 263/511] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:36.589209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.602219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.611951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.612776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.613060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.613339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.623800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.625319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:36.642840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:36.643674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:36.644506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:36.644506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:36.644506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.644506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:36.644506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 249/512] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:36.644803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.688162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830fb60-97a8-4e97-94f2-0c84337ab30e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.702189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.722418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.723067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.723350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.723628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.741988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b5fc4-2930-4a2b-bfcc-347f42e18168 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.774325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.774998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.775421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.775725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.776465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:36.776814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.778216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.789835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.790229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 250/513] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:36.791023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.791300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.830578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.891627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade393b1-a213-4919-b702-84ef62635f6d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:36.893578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 264/514] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:36.894429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.910343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:36.926662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:36.927463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:36.927740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:36.928011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:36.938040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:36.939511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:36.957918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:36.958756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:36.959582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:36.959582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:36.959582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:36.959582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:36.959582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 251/515] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:36.960203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:36.994153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97057212-ebc7-47fd-aef4-c16cdb788b7f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.027831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.028508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.028820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.029092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.029977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:37.030278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.031710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.048404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 265/516] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:37.049242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.058540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.068906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc0af7-9ebb-48fd-a1be-fe496d353648 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.103536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.104198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.104479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.104776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.105501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:37.105805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.107221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.117458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.118939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 252/517] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:37.119838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.145911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06bf79-494c-4832-9c42-ddbcf7dbd76d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.183828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.184581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.184799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.185069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.185841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.187427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.217957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1bd6d3-b1f3-4b19-8de7-792179bf81fe None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.218512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 266/518] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:37 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:37.219071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.259734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.260451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.260748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.261022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.272958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.274467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:37.293628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:37.294569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:37.295420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:37.295420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:37.295420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:37.295420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:37.295420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 253/519] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:37.296073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.302971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.343744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62c4a6-5aa2-4029-9809-b9445a8f64a8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.377221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.388120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.388918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.389370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.389668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.390381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:37.390691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.392339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.405931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 267/520] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:37.406356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.426320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223825b0-9ff1-4c66-81b4-43a1ad834f96 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.461477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.462128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.462410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.462683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.509640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eb28d-fa8f-4c1f-813a-1f39233b81b0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.538309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.539984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.542089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.543040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.543842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.544124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.544400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.551872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.553398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:37.569040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:37.570020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:37.570886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 268/521] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:37.571433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.622224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.664406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 254/522] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:37.665628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.678972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22bb38-488c-4219-a162-9490f502228a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.713945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.714617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.714895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.715173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.715930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:37.716235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.717859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.729423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 269/523] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:37.730058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.782890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258852-e5fc-409d-b2a7-df95fbc35de4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.784965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.823118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.823830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.824113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.824382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.831887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.833605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:37.848781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:37.849652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:37.850644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 255/524] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:37.851112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.853010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272fe95-b0ab-44e7-b64b-d43d7de8042b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:37.864189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:37.893427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:37.894107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:37.894392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:37.894671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:37.895545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:37.895858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:37.897333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:37.920956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 270/525] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:37.920956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:37.966757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d7e26-b84c-4121-ab7e-0d62ea654f43 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.005566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.006371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.006654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.006927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.018037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.019509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.029870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4619a0a-0b41-4871-b41c-dfb48c83bd74 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:38.040303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:38.041290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:38.042111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:38.042111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:38.042111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:38.042111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:38.042111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 256/526] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:38.042396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.061512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.067993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.068824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.069108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.069381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.076461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.077931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:38.093639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:38.094623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:38.095513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 271/527] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:38.096056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.127141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.157611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c5e7a-0b14-432e-9011-ccd2b5d16906 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.193690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.194356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.194637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.194909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.195700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.196008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.197547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.204889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc81007-cb05-419b-884a-4ed2589ecde5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.220369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 257/528] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:38.220369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.247300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.248076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.248476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.248854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.296923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.318893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.320282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.329573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa5513-9354-48c1-a356-ae4872b44a5c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.348624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.366981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.367661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.367943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.368216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.368974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.369284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.370688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.383411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 258/529] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:38.384231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.434789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 272/530] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:38.436001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.494217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce620d1-fc31-4eb9-b0c5-c7926fb4c53b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.537017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.538301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.539003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.539431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.540375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.540741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f8b1e-9d55-4441-b541-661c2fb8db21 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.540991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.542764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.546006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.567238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.567659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 259/531] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:38.568893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.578305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.578975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.579833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.580062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.580940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=aec0cfd566b94d8798716eb95fa75a60) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.581636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.583425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.589366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 273/532] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/role_assignments?user.id=aec0cfd566b94d8798716eb95fa75a60&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:38.590115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.710097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e9ad6-0f09-4f59-a82e-d3e0a0c94bf5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.714202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a361a6-c37f-4713-adfb-2ae4610c984d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.758284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.759008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.759286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.759557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.760074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.761113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.761586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.762073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.767459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.769276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.773618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.775171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:38.784450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:38.785345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:38.786162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:38.792931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 260/533] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:38.793711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:38.794486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:38.795918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:38.795918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:38.795918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:38.795918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:38.796842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.799717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 274/534] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:38.800878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.857059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.858629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:38.906448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcedc-90c1-43be-88fc-d7b2536994dc None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.917295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed1156-cf45-47e6-b0bd-a6795be17135 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:38.942995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.943960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.944410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.944932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.945986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=4e17921df6504f73b8a743b477924590) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.946487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.948105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.953748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:38.954497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:38.954848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:38.955192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:38.955535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 261/535] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/role_assignments?user.id=4e17921df6504f73b8a743b477924590&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:38.956676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:38.964916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:38.964916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:38.966343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:38.972192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 275/536] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:38.977637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.101083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd2784-e425-45f8-8589-aa9aa01f2913 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.102807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:39.141263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.142121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.142480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.142921 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.150847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.152438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:39.167731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:39.168653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:39.169823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 276/537] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:39.175116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.177558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee7272-b8e4-40ce-a4ae-18491d1b9563 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.209806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:39.243993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.244679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.245013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.245291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.246098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:39.246417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.247891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.264710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 262/538] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:39.271548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.292835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9fdbc-5cf4-476b-bb75-70be4387e836 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.330290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.331322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.331795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.332280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.333304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:39.333801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.335429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60d523-1350-40c5-a6e4-45977a498aec None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.355172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 277/539] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:39.356990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf285d-785b-447f-a034-907698384689 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.357679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf285d-785b-447f-a034-907698384689 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.358256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf285d-785b-447f-a034-907698384689 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.360127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 278/540] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:39.361055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf285d-785b-447f-a034-907698384689 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.386937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:39.402366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e931b-b846-4ccb-849c-5ffa96b0a5b9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.444081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.444758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.445043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.445328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.446589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:39.446903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.448744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a2136-02b3-4b42-aacf-a7f63cb6f847 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.461589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 263/541] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:39.461589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.461589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.461589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.496238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:39.497512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:39.503585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf285d-785b-447f-a034-907698384689 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.580114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.581250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.581768 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.582244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.582841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:39.583300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=7b6e8b195e224b68bc4d5bc0c04db9dd) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:39.583646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.589573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.596606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 279/542] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/role_assignments?user.id=7b6e8b195e224b68bc4d5bc0c04db9dd&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:39.603020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 264/543] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:39.627536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.724157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:39.740342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e8d74-5236-46a5-87e2-c48d98cafa1f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.775723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.776530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.776839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.777118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.788863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:39.797136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:39.798101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:39.799337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 280/544] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:39.804864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:39.908797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdcce9-05cb-4d9b-8739-b037ff1f9287 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:39.943772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:39.944451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:39.944746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:39.945039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:39.945796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:39.946101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:39.947519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:39.956407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 265/545] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:39.961854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:40.094486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd0b8-f4a6-4eda-aaa0-a61505454bff None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:40.139793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:40.140603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.140913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.141191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.157269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:40.158796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:40.165308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:40.176556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:40.177405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:40.178649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:40.178649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:40.178649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:40.178649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:40.178649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 281/546] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:40.183613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:40.220537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:40.286984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdeddc-2e9c-41fa-a6e8-97a27f16bcac None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:40.322033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:40.322747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.323032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.323305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.324078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:40.324387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:40.325817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:40.337905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 266/547] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:40.346042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:40.465632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d96a2-04e9-4f4e-9690-1527b3e3c414 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:40.500083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:40.500927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.501209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.501478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.509893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:40.511421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:40.526494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:40.527493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:40.529055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 282/548] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:40.535925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:40.637711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:40.641729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb5b7-76ce-4b6d-b6ca-7cc339f9b298 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:40.676182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:40.676880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.677163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.677437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.678278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:40.678587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:40.680040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b58e0-811d-4e2d-a823-978a65260838 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:40.698044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 267/549] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:39:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:40.705842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:40.770265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:40.814427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d3d15-f184-49e0-adeb-026b763a2e26 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:40.849460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:40.850180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.850464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.850739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.853313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be26-5316-4651-843e-0f71e8774f08 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.853607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be26-5316-4651-843e-0f71e8774f08 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.853886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22be26-5316-4651-843e-0f71e8774f08 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.855509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 268/550] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:40.860657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:40.860989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:40.861269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:40.917804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:40.918955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:40.922306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:40.923858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.011810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.069614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 269/551] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:41.090614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 283/552] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:41.092508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.100740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.221371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.241684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5f217-850e-4f20-9eea-e20e5d002574 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.277628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.278770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.278961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c670949-7b7f-4c46-8acc-7bbb3b7ab736 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.279551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.280081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.291047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:41.304138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:41.305200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:41.306037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:41.308812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 270/553] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:41.321629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.339770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.340327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.340607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.340942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.351429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.352931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:41.370760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:41.371660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:41.372951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:41.372951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:41.372951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:41.372951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:41.372951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 284/554] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:41.377652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.393077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.437702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443f064-f33c-4bc0-bb02-362da2f771c2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.474917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.475942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.476416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.476910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.477851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:41.478368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.479971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.493536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 271/555] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:41.499494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.510412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4239b6d-9f78-4b2b-8f61-047697570ac7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.516487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.568061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.569375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.569853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.570314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.571251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:41.571744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.573333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.598903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 285/556] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:41.604342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.717720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008fbc-2fd8-47f3-bd63-f687514d9208 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.731522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.761054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.762127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.762413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.762690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.771390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c564e-11bf-4fd9-8cd2-2d8ff02704c8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.776112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.777625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-921cbaf7-9eb6-486a-8984-95fae4fd17a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:41.799416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:41.801133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:41.802247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:41.802247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:41.802247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:41.802247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:41.804936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 272/557] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:41.806681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75496-52e8-4334-80d3-7b7332c1bd3f None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.806963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75496-52e8-4334-80d3-7b7332c1bd3f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.807234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb75496-52e8-4334-80d3-7b7332c1bd3f None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.808643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 273/558] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:41.810888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75496-52e8-4334-80d3-7b7332c1bd3f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.823082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.823880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.824155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.824430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.834692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.836445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-02cbfb01-9394-410a-aa04-1d3860d0ac19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:41.857319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:41.858283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:41.859218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:41.863495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 286/559] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:41.865448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.865738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.866017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.884876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:41.891687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:41.893579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:41.940058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb75496-52e8-4334-80d3-7b7332c1bd3f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:41.977031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 287/560] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:41.978261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:41.981923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:41.982837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:41.983267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:41.983662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:41.984566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:41.985021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:41.987457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.002781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 274/561] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:42.016400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.069007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.114099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d05ba-b2f0-47e7-acd4-402616c6a24f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.130837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47e86c-bdc2-42d8-80b8-eddb04d2174b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.146964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.147309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.147993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.148364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.148612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.149471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:42.149806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.151275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.162536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 288/562] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:42.163333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.164792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.165602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.165893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.166165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.177013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-a7877682-0e78-458e-bada-378512fca9c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:42.184837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:42.185977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:42.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 275/563] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:42.187676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dcab-4cc3-4952-952b-3cbf8fa94271 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.187848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dcab-4cc3-4952-952b-3cbf8fa94271 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.188126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13dcab-4cc3-4952-952b-3cbf8fa94271 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.189424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 276/564] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:42.190488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7ce50-c13c-444f-a623-bbd360d21e24 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.190768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7ce50-c13c-444f-a623-bbd360d21e24 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.191043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7ce50-c13c-444f-a623-bbd360d21e24 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.192881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 277/565] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:42.193282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7ce50-c13c-444f-a623-bbd360d21e24 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.269239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4392d-8c3b-435d-bfd2-8df0083b2383 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.287962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.299686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7ce50-c13c-444f-a623-bbd360d21e24 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.301919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.302713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.302989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.303258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.311260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.312692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:42.326955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:42.327862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:42.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 289/566] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:42.329383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.338887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.339543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.339828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.340101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.340976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=b96d8006e32d48379aba33d842b0f000) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:42.341379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.342902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348054fd-84e4-4df0-a2a4-106cb5bb70e3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.348407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 278/567] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/role_assignments?user.id=b96d8006e32d48379aba33d842b0f000&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:42.349615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f111ed-d42d-4978-9ff3-0b16431a1769 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.349905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f111ed-d42d-4978-9ff3-0b16431a1769 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.350184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f111ed-d42d-4978-9ff3-0b16431a1769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.368757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-12f111ed-d42d-4978-9ff3-0b16431a1769 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:42.370040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-12f111ed-d42d-4978-9ff3-0b16431a1769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:42.416647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.452753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad413da-f5f4-4ad5-a894-283db16214f2 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.467867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 279/568] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:42.467867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.467867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.467867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.481370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:42.482646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:42.494845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.495527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.495805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.496077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.496864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:42.497169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.498617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.507456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 290/569] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:42.508292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.559772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.561325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 280/570] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:42.562407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.636604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ba2d-790b-4247-ace0-6358f67d7865 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.673791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.674468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.674750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.675024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.675984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:42.676364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.677402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.678955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.679474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e40480-8fc5-407e-af7b-7f8c467f2031 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.703995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 291/571] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:42.703995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.720377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.721217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.721498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.721769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.732161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:42.740255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:42.741210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:42.742022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 281/572] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:42.742684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.809039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.812490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c27e-ab2b-4d59-a2b9-0c7f24562593 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.847275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.848071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.848352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.848622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.849731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f767-a47b-481f-84bd-ef92b03eaf5a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:42.858941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:42.860398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:42.878256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:42.879237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:42.880082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:42.880082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:42.880082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:42.880082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:42.880082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 292/573] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:42.880355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.893520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:42.894325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:42.894599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:42.894865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:42.905458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:42.913165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:42.914068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:42.914880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 282/574] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:42.915562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:42.938303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:42.992664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd00de-75fb-4192-b828-fa2616c9ff65 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.027100 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3be5b-30fc-4ed3-8353-4c2db1429a48 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.031367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.032176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.032458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.032764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.043265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.044775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:43.064549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:43.065640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 293/575] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:43.066834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.071372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.073696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.074450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.074803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.075146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.075975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.076440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.078369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.093681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 283/576] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.093681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.174689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b44d-4d68-4ab5-b7a7-69c7640add55 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.183401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.203387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808984b-e24d-4460-b3a1-5bcafbbf3106 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.211317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.212002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.212274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.212546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.213326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.213620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.215142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.228160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 294/577] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.229008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.250325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.251323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.251748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.252163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.253372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.253846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.256033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.267278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 284/578] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.268083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.302125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.345522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27df2da-b10d-4194-947b-c0ae6e947a2c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.375852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89075fe4-89f3-4e0c-aa4c-ce701f4cc0f6 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.381107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.381774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.382061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.382335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.383049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.383353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.384753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.397670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 295/579] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.398491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.417734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.418683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.418911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.419239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.431656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.433204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.437044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:43.454806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:43.455764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:43.456616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:43.456616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:43.456616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.456616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:43.456616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 285/580] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:43.457805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.511293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78f0f6-de05-4aea-87b8-8a205acb8f65 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.540152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.553612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.554429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.554692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.554964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.562850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.564462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.566288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7df521-bd2e-40b8-87f4-2d25c5340363 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:43.579491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:43.580434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 296/581] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:43.581479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.608637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.609405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.609689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.609966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.620466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.621967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:43.639573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:43.640469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:43.641370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:43.641370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:43.641370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:43.641370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:43.641370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 286/582] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:43.641676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.694040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd287a3-b96f-4c50-8579-c1a384cca71d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.694974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.729889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.730687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.730969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.731254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.738445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.739887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.749643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cfc9a-4b51-4adb-a59c-a4cef3843a79 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:43.753561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:43.754420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:43.755295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:43.759370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 297/583] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:43.760078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.785817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.786489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.786767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.787037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.787757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.788060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.789482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.801510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 287/584] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.802229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.811918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.869623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e840f1-51f0-4055-8150-ac4bc41c798b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.903583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dbb50-b277-42ec-8667-be9aca8a6f89 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:43.905980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.906664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.906949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.907221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.908066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.908373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.909844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.914115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:43.929901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 298/585] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.930841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:43.947185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:43.947996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:43.948372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:43.948757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:43.949589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:43.950012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:43.951529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:43.963413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 288/586] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:43.964505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.037366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d712e-78b0-45d5-8611-b737c4d6e681 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.039046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.072344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.073199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.073575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.073961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.074858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:44.075234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.076944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.080379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264b2ee-78de-4c01-bcb9-4fd34158615c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.093411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 299/587] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:44.093411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.124027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.124933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.125322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.125487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.133064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.134583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:44.149725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:44.150661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:44.151600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 289/588] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:44.152185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.181583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.198168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eab506-a677-4489-8c7a-251a31181d4c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.233162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.234191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.234467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.234741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.247006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.248892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.262768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c5335-eaf6-40c9-84a2-4d6ce915b1a8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:44.268385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:44.269451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:44.270567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:44.270567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:44.270567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:44.270567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:44.275962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 300/589] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:44.277310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.296898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.315237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.316883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.317314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.317777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.328920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.331154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:44.348565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:44.349535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:44.350425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:44.357040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 290/590] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:44.357929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.402539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b6c22-71a3-44dc-b0b5-8badb53cde81 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.444509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.445468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.445751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.446022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/aec0cfd566b94d8798716eb95fa75a60/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.451031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.463232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01baf841-fcd8-414b-8c49-d3603113c2fd None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.463455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=aec0cfd566b94d8798716eb95fa75a60, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.464943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.484903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 301/591] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:44 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/aec0cfd566b94d8798716eb95fa75a60/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:44.485889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.512839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.513731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.514067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.514405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.515478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:44.515799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.517756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba5872-95c8-4f6d-b8ab-51e2dcb806c4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.544768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 291/592] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:44.544768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d73d9-c82e-435f-96a5-9143cc8b08a2 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.544768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d73d9-c82e-435f-96a5-9143cc8b08a2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.545268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d73d9-c82e-435f-96a5-9143cc8b08a2 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.550814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 292/593] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:44.551798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d73d9-c82e-435f-96a5-9143cc8b08a2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.589586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.647504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f493ef9-3705-4e84-95f1-9c3f07f09f75 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.673758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d73d9-c82e-435f-96a5-9143cc8b08a2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.684083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.685100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.685620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.685863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.686647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:44.686949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.688325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.701551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 302/594] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:44.702745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.716551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.718855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.719142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.719396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.720244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:44.720579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.722070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ceb0e-5006-4518-8983-bb0259aa2047 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.747616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 293/595] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:44.747616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.747616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.747616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.752116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.763878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:44.765134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:44.820132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4352139-0b0c-4a16-8dfb-39efef312155 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.835104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 294/596] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:44.841845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.844826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:44.856626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:44.857674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:44.857954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:44.858261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:44.869301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:44.870754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:44.888112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:44.889309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 303/597] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:44.890278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:44.970655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbff727-8077-4f4a-ab4e-08abf9e6a706 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:44.997873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe52-ef7a-41f2-aec3-20e883ac3c92 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.011932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.013156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.013723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.013912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.016270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.027350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.028619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.036307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.037217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.037567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.037910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:45.042980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.043814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 295/598] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.045500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.055071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.056547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:45.077220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.078232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.079107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:45.079107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:45.079107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:45.079107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:45.079107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 304/599] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.079394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.113116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.156133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba88d7-0d1e-44ff-ace2-575c3da6a0c1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.191360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.192481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.192786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.193060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.193594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d2c4c-057c-4b70-835e-d5884746d942 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.203608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:45.211519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.212607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:45.213581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 296/600] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.214333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.233601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.234188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.234472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.234746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.235479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:45.235791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.237242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.249252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 305/601] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:45.250058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.283511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.334765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bcbce9-4da0-49b8-a96b-121ff3d186c8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.343298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.357913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884cd1d-e8e6-4526-9a41-6689a289d702 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.369896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.370562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.370845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.371132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.371913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:45.372225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.373710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.390358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 297/602] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:45.390358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.400557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.401417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.401593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.401823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.402599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:45.402865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.404303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.416413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 306/603] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:45.416413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.492684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f41e071-fd5a-48e1-9988-7cb6abb057d5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.506971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.525400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7b0b9-540c-42d4-9a80-8307bf365ff0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.528949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.529674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.529955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.530225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.530978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:45.531285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.532683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.541043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 298/604] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:45.546435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.566247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.567371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.567656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.567930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.576262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.577773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:45.592974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.594361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 307/605] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.595235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.607815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.660170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9355cf-a65b-4a51-b759-99f09bb94187 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.701139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546ef25-ea45-4a86-a7ae-642444bdb5a5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.702224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.703231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.703400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.703675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/4e17921df6504f73b8a743b477924590/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.720103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=4e17921df6504f73b8a743b477924590, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.721652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.744838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 299/606] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:45 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/4e17921df6504f73b8a743b477924590/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:45.744838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.747240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.748233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.748627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.749156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.757793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.759380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:45.775354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.776324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:45.777250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 308/607] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.778216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.779158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.858625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:45.874782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848fb1b-13ae-48fd-83f2-50b6876adeaa None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.906829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b517fd2-de23-45c2-b299-d44250cde632 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:45.924673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.925928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.926495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.926976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.939959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.942901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.945208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:45.945880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:45.946161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:45.946436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:45.947227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:45.947534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:45.948976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:45.962001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 309/608] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:45.962843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:45.963030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:45.963904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:45.964880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:45.964880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:45.964880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:45.964880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:45.964880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 300/609] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:45.970456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.074161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:46.078490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0d96-88ef-4c35-b02f-b16fe98fc189 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.098255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6f69f-a0a7-45c2-bd4e-a3c32c038eb3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.112762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:46.122961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.123776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.124121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.124422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.125497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:46.125810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.127970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.137315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.138193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.138747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.139173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.140044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:46.140493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.142044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.147046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 310/610] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:46.147046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.160802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 301/611] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:46.162027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.276311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41899-1024-46af-932b-0da0f7fafcf5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.280325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33f26d-1ff8-4ef7-bcad-34a8fb27ffee None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.317544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.317792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.318529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.318808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.319078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/7b6e8b195e224b68bc4d5bc0c04db9dd/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.319678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.320277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.320822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.335486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=7b6e8b195e224b68bc4d5bc0c04db9dd, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.337312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.341043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:46.343038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=644364ac21704f9281845a8af6fa0b30, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.344743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.368748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 302/612] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:46 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/7b6e8b195e224b68bc4d5bc0c04db9dd/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:46.368748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.373111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 311/613] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:46 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:39:46.532434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2712c-d4be-45d7-b12c-3a15f159786c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.582750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.583572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.583859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.584140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.594785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.596298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-637e6801-78b8-42a6-8997-328578e1f563 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:46.614935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:46.615940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:46.617507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 303/614] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:46.621962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.656892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3ab5-2ebc-4043-9c0f-50a47f405167 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.657234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3ab5-2ebc-4043-9c0f-50a47f405167 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.657496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d3ab5-2ebc-4043-9c0f-50a47f405167 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.659173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 304/615] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:46.664057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.664338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.664611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.667733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:46.685941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:46.687483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:46.761090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:46.763981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f21b-768e-4c91-97f7-919cb4cb2120 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:46.801677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 305/616] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:46.826398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.834377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:46.835072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:46.835356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:46.835633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:46.836489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:46.836831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:46.838373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:46.874465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 312/617] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:39:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:46.880079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:46.997042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28792d50-57e0-4abd-aa7d-3a87632847e6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.001091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:47.007600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99bcc2-b1ab-496c-8501-293b86b9d9c1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.047778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.048810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.049195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.049570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.067745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.069780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.072108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.073044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.073440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.073809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:47.102739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:47.103681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:47.104524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:47.104524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:47.104524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:47.104524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:47.104851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:47.112113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:47.114282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:47.116282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 306/618] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:47.117436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 313/619] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:47.120567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.127466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.198103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:47.268935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73d531-194d-4cb2-a01d-dd6aa87010b1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.336620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d3a2d-41cc-4e83-8249-7830cf9c3e83 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.339390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.340081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.340366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.340644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.343014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:47.343338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.344785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.363603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 307/620] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:47.369208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.411396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.412887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.413176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.413452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.414184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:47.414493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.415880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.435004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 314/621] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:47.444667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.468818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:47.497505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:47.500221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6031d5-4ed8-4e21-8993-f062c2cad53f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.534991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.535941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.536294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.536638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.547893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.549482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:47.569949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:47.571421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:47.573392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:47.573392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:47.573392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:47.573392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:47.573392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 308/622] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:47.577321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.621888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109e1d5-b64a-42cb-bc55-46be2f4bfcb6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.659552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.660353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.660639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.661014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.668375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.670060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:47.685092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:47.687046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:47.689194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 315/623] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:47.696739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.763083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:47.799884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90258a63-3517-47b0-acd2-08b58a8162e3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.823455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ec814-d762-4811-80f4-814e1971b57d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:47.849098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.849783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.850066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.850342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.851159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:47.851475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.853003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.879319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 316/624] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:47.886707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.903056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:47.903730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:47.904012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:47.904369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:47.905105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:47.905414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:47.906822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:47.934268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 309/625] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:47.939986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:47.982525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.040263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1cc99-4a83-493a-85fb-a815e779d33d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.068383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.077206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.078114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.078399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.078675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/b96d8006e32d48379aba33d842b0f000/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.094044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=b96d8006e32d48379aba33d842b0f000, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:48.095565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a32dd-75ca-414a-9430-9068474a0cda None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:48.112126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 317/626] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:39:47 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/b96d8006e32d48379aba33d842b0f000/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:39:48.113663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa46e2-a425-42d1-b821-2e037130b62b None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.113962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa46e2-a425-42d1-b821-2e037130b62b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.114454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa46e2-a425-42d1-b821-2e037130b62b None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.116777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 318/627] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:48.131627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.131832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.133260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.170617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:48.171846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:48.197225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101f591-2c33-43bf-9130-62915c65c2f0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.241468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.242291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.242720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.243082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.251454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:48.253027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:48.269274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:48.270358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:48.271694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 310/628] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:48.276617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.326936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 319/629] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:48.353377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.371036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.418087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc916e88-8ec8-4df8-8ecc-cfb3375e81e0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.479830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.480929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.481417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.482010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.483436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:48.483955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:48.485799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:48.506847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbffb4-b6f6-4421-aa4f-2aba0549fe2b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.514907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 311/630] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:48.523157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.531918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.582243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.583495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.584010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.584481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.609914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-6a42adf6-e2d4-4966-8651-59445276ce19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:48.627291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:48.628264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:48.629102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:48.632174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 320/631] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:48.633554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1723e-1ba5-4721-b2b7-6c9b6058fb75 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.633840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1723e-1ba5-4721-b2b7-6c9b6058fb75 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.634116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1723e-1ba5-4721-b2b7-6c9b6058fb75 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.639472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 321/632] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:48.640293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1723e-1ba5-4721-b2b7-6c9b6058fb75 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.692192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76530175-1a4c-4d83-89ae-a5570ef11eb0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.730088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.738496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.739304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.739590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.740175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.746267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1723e-1ba5-4721-b2b7-6c9b6058fb75 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:48.783912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:48.784690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.785008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.785279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.786092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:48.786395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:48.787839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78128-43a6-4507-8675-4f97e3e328f1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:48.797106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 322/633] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:48.798480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.798804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.799077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.820476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:48.821324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:48.821810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:48.822805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd4342-d738-4805-9a74-0762cf8d35a3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:48.850676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:48.909120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 323/634] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:48.910543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.936049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 312/635] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:48.937433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c6fe-6013-4130-8d86-3195e51a8934 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:48.937721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c6fe-6013-4130-8d86-3195e51a8934 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:48.937999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2c6fe-6013-4130-8d86-3195e51a8934 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:48.940753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 313/636] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:48.940753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c6fe-6013-4130-8d86-3195e51a8934 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:48.971848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.035923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395a36c-9245-4f6d-b5f4-3a781d288443 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.050220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2c6fe-6013-4130-8d86-3195e51a8934 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.073385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.074184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.074472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.074751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.084841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.085507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.085613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.085884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.086151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.086960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.096701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:49.104325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.105248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:49.106092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3d9a19ba-c67b-4b6b-a0d9-2bceeaa8ce91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:49.106723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.107575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.108440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:49.108440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:49.108440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.108440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:49.108651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 314/637] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.109659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 324/638] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.109659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.109659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.109659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.111117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.129339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:49.130524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:49.138112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.200243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 325/639] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:49.201285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.219577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.231920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fd777-3e57-4b2b-a470-4d30c26eec92 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.270804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.271705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.272054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.272428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.283659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.285246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:49.303910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.304879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 315/640] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.310549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.326743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f79d7-7179-4878-873a-e2d9e77e417f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.363206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.363877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.364160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.364456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.365206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:49.365510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.366887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.397163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 326/641] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:49.400155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.405253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.425779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c0142-129f-4de5-b361-fe96c20e1306 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.464611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.465704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.466246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.466718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.467772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:49.468225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.469960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.478956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 316/642] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:49.480057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.484614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.521511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d3a13-ffd1-4403-a7ba-e91918f162cf None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.555714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.556499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.556834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.557094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.567736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:49.575374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.576462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:49.577342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 327/643] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.578044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.594806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd04ad-8606-462b-aeaa-cc807d2575a8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.631214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.631872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.632152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.632426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.633172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:49.633480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.634857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.642318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.647357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 317/644] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:49.648229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.692140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f32e-f81b-4898-b307-74400bc6803d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.715404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.726027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.726853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.727138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.727415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.737206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.739312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:49.755212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.756610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 328/645] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.757710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.761393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de50582-e7e4-4c07-b25f-cd72c9920824 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.799510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.800332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.800615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.800918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.812383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.813970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:49.833387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:49.834319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 318/646] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:49.835795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.876218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba04545-0e2b-4dff-9360-e2fde1bbe06a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.903015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.916315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.917026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.917315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.917595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.918350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:49.918661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.920849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:49.929621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 329/647] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:49.930430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:49.950215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1288abe-4f04-4b0e-bd1c-549e70be7f48 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:49.967995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:49.987567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:49.988294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:49.988578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:49.988886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:49.995969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:49.997476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:50.011560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:50.012493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:50.013385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:50.017480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 319/648] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:50.018224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.043908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e786246-45be-4713-a8f5-0f4048f514e3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.082411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.083095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.083377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.083650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.084502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.084844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.086284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.104780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 330/649] 10.222.0.23 () {56 vars in 1137 bytes} [Mon Jun 20 14:39:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.105614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.150535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eea631-f97a-4985-9b9a-ee5a267ff61f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.155909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.193793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.195098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.195615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.196215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.197571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.198322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.200361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.216784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267a166-89d6-4064-a4d0-6256557f797b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.219177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 320/650] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.220130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.255249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.256095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.257128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.257480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.257774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.268430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.270024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:50.289209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:50.290127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:50.290978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:50.290978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:50.290978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:50.290978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:50.290978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 331/651] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:50.291243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.332688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db71e9a-9b27-4c28-bdc3-3d763b9b276f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.366893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.367543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.367822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.368092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.368907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.369216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.370662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.382434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 321/652] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.383212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.389317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.397412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86232426-6213-4a60-bc07-56ec0591b329 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.432179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.432876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.433159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.433431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.480227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.487059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af62325-0a21-4aca-a003-f2f709f7bbae None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.502247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.503735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff7f01-b514-4011-92eb-55dc4e82f55e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.520624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.521383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.521659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.521951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.529338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.530927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:50.544920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:50.545855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:50.546755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 322/653] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:50.547333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.598753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.609424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 332/654] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:50.610740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611751-b417-4397-99ec-d15cf0396008 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.611022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611751-b417-4397-99ec-d15cf0396008 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.611303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0611751-b417-4397-99ec-d15cf0396008 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.612837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 333/655] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:50.613547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611751-b417-4397-99ec-d15cf0396008 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.651557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2178c7-34af-427d-8f19-9a9e8b781080 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.684870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.685611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.686095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.686374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.687090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.687395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.688810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.700534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 323/656] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.702668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.713318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0611751-b417-4397-99ec-d15cf0396008 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.721098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.746328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.746977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.747251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.747522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.748561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=aec0cfd566b94d8798716eb95fa75a60) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.748893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.750317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.756291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 334/657] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/role_assignments?user.id=aec0cfd566b94d8798716eb95fa75a60&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.757133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.814488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7a0f7-0085-498c-84d7-898ac2534dba None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.823658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:50.855543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.856329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.856615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.856928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.857857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:50.858165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.859634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72b3d7-8f40-4e58-b354-7ff5cfb872a6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.872366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ca9c-fa0a-4ce0-83fc-cd6b0d6ebb30 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:50.884383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 324/658] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:50.885738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.886031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.886308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.904708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:50.905951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:50.909144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:50.909947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:50.910220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:50.910491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:50.923735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:50.925831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:50.945640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:50.946561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 335/659] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:50.947720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.987732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 325/660] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:50.988593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:50.991703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.064292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660eaca-b8f6-429b-b16c-21da23c0eda5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.076880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.098553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f79dd-0910-4645-97ec-379518358d8f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.101886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.102691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.102969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.103239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.111352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.112831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:51.126960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:51.128105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 336/661] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:51.129633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.140492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.141189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.141472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.141744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.213931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.215410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.219059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.233991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a3ae9-f9f3-4b60-a96d-62fd50bc037c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.268779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.269447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.269725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.269999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.270796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:51.271070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.272379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.285040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 337/662] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:51.285959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.317050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.321926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 326/663] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:51.322624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.396272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2681-72f3-41f9-9794-0e01fa2046ec None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.423594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a5076-dc72-445e-bfe8-e56eb5707c64 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.425905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.432331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.433377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.433924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.434203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.446823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:51.454845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:51.455755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:51.456572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 338/664] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:51.457300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.466411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.467132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.467417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.467678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.468514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:51.468849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.470728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.492757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 327/665] 10.222.0.23 () {56 vars in 1139 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:51.492757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.555601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.566147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c3fbd1-3125-456d-a39d-b30df4433d5a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.602212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.603012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.603291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.603563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.604605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10004fc5-63eb-4596-aa4e-7b66e225088a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.610404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.611854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:51.626211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:51.627088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:51.627958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 339/666] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:51.628438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.647921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.648635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.648954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.649223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.659290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.660776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:51.678248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:51.679349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:51.680273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:51.680273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:51.680273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:51.680273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:51.680273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 328/667] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:51.680611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.699060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.739038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5af2-23ea-4fd4-afdd-d1d9775f4a5d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.774650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.775335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.775607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.775854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.776601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:51.776974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.778374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.787253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 340/668] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:51.788364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:51.796304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55a369-b6d1-4370-afb7-825781028be8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.804831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.835992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.836980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.837262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.837534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.901508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f75f2-381a-48a1-97d4-e1ca259630c0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:51.907147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.908782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.925723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:51.942080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:51.942854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:51.943129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:51.943394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:51.944180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:51.944482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:51.945929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:51.958914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 341/669] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:51.959767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.030263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 329/670] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:52.031198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.040013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.073748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ab21d-dbd2-4c6f-940e-781cf8a67141 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.109774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.110526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.110820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.111098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.111827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:52.112135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.113541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.125313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 342/671] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:52.126013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.137517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fc791-f731-4fab-a26e-4b5a33909dd9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.153458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.175854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.176646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.176971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.177243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.187381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.188973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:52.206474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:52.207551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:52.208460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:52.208460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:52.208460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:52.208460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:52.208460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 330/672] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:52.209308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.236461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901e675-7529-444a-a6e7-60cb7e4fcb21 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.267147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.273174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.273835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.274112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.274383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.275218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=4e17921df6504f73b8a743b477924590) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:52.275523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.276968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.292744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 343/673] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/role_assignments?user.id=4e17921df6504f73b8a743b477924590&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:52.292744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.347687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671273ce-47cf-4e9a-b4c8-c74b8771017f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.401528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.402622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.402913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.403197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.407830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3bca4-13cc-440c-9009-0e2d7bc34544 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.417425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.419462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:52.445543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:52.446663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:52.447940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:52.447940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:52.447940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:52.447940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:52.448386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.448386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.448386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.448386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.450861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 331/674] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:52.450861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.463409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.464871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.479944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:52.483139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:52.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:52.484982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:52.485408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 344/675] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:52.487261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.557068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.596297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48583949-4bca-494e-89ec-c22a69f950e4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.607147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aae859-7ea6-45ec-a731-c266eec7c8b7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.644151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.644847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.645134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.645407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.645893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.646137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:52.646447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.647167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.647697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.647868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.648320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.649316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:52.649834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.651392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.664964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 332/676] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:52.664964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.673047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 345/677] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:52.674487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.773199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.794534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf4b76-912d-4cf4-b063-5bd794304080 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.798741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45fcb4-81ea-4fca-8593-fcc950ad54e4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.818677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:52.836055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.836921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.837299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.837673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.838733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:52.838959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.840705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.846121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:52.846935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.847220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.847493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.855698 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:52.856872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 333/678] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:52.857263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:52.858440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-9830ff7b-229c-49ed-aaf7-f49583b27739 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:52.872550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:52.873840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:52.874965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 346/679] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c786f-a345-450b-8933-3e6a2fc3163a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c786f-a345-450b-8933-3e6a2fc3163a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c786f-a345-450b-8933-3e6a2fc3163a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 347/680] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:52.881205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c786f-a345-450b-8933-3e6a2fc3163a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:52.985786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b027b7-bacf-4f03-986c-281a9ea2f2f3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:52.987313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c786f-a345-450b-8933-3e6a2fc3163a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.024244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.025040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.025459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.025806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.026723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:53.027125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.028549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.031515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.032706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.032706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.032917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.044765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 348/681] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:53.044765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.047081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.048689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.052051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ae984ae9-8b63-4e8b-b38e-57c978e70a33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:53.069451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:53.070694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:53.071776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:53.077131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 334/682] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:53.078439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.078731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.079004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.102255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:53.103527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:53.107348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.176144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c3499-db46-4c02-adf8-a7e38c6c0642 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.196842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 335/683] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:53.196842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.233465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.234532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.234906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.235276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.236296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:53.236645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.238199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.257713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 349/684] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:53.258684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.319346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ecc7fa-d8a0-44c5-8c9a-17660d479b26 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.349623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.360218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.361082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.361458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.361851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.362946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:53.363072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.364672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.368405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.375124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f29857f-1353-4eb5-b567-5489ee899fb5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.380752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 336/685] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:53.380752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.416749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.417763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.418060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.418401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.430088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.431669 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:53.454462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:53.455606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:53.456703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:53.456703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:53.456703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:53.456703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:53.458309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 350/686] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:53.464256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.498684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6063e-c88f-40f7-b513-dcdbd4a9ad63 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.534641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.535682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.536161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.536632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.591653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72952d06-a945-49e8-a79b-aacbce480938 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.605097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.608521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.611015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.641427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.642480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.642954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.643425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.644469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=7b6e8b195e224b68bc4d5bc0c04db9dd) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:53.644999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.646717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.653274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 351/687] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/role_assignments?user.id=7b6e8b195e224b68bc4d5bc0c04db9dd&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:53.654381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.672228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.735629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 337/688] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:53.744219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.838200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:53.853886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86724d64-cc91-4cb4-8b9f-dacf458cac49 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.858363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461cdf9-5c0f-4366-bd84-de4fe35a6633 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:53.893243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.894046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.894384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.894661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.905646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.907111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.907960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:53.908737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:53.909098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:53.909446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:53.910180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:53.910488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:53.911844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:53.926640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:53.927734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:53.929021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:53.929021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:53.929021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:53.929021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:53.929299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 352/689] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:53.929390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 338/690] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:53.937867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:53.938032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:54.038271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:54.047478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb09a99-1d2a-4bf8-8d62-b6ca65b4325e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.081677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:54.084751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.084751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.084751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.084751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:54.085066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:54.097069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facf4d4-5708-4940-a561-9e663393a2a5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.107736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:54.120423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 339/691] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:39:53 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:54.153853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:54.154583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.154858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.155132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.155941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:54.156261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:54.157694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:54.179484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 353/692] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:54.185162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:54.295976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916358e-819c-4304-815b-bd3711b81d07 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.332809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:54.333623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.333907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.334181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.341275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:54.342984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:54.357741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:54.358626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:54.359531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 340/693] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:54.364905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:54.470826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be4525-af5b-4215-8793-b368210c2a64 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.509623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:54.510368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.510652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.510978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.511786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:54.512097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:54.513643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329debbf-3f10-4723-b6fb-e0182d86718d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:54.515453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:54.532317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 354/694] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:54.538452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:54.578502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b73d9-b256-4514-8032-23f9ef5d28af None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.578866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b73d9-b256-4514-8032-23f9ef5d28af None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.579150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b73d9-b256-4514-8032-23f9ef5d28af None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.580841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 355/695] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:54.587056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.587342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.587617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.617606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:54.619722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:54.633494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:54.732596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 356/696] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:54.747668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff3ce4-98ac-4be1-9523-8783cb0e3d6d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.761899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:54.818892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:54.819968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:54.820430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:54.820917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:54.822426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=b96d8006e32d48379aba33d842b0f000) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:54.822953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:54.825536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:54.848501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 341/697] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:54 2022] GET /identity/v3/role_assignments?user.id=b96d8006e32d48379aba33d842b0f000&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:54.941317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc1225-d7ba-49ca-9252-5a96e1dcd588 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:54.989133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:55.017915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:55.018781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:55.019068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:55.019339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:55.020017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:55.021511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:55.042346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:55.043341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:55.044154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 357/698] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jun 20 14:39:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:55.053881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:55.223612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e69e8-dec9-4389-9deb-1a21bdd2337e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:55.248974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:55.267305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:55.268529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:55.269045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:55.269533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:55.270428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:55.270923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:55.273234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef945f-59a7-49d7-9cc4-f160f1bdb792 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:55.278652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 342/699] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:39:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:55.285528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:55.403650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59cb4f-cf87-4845-aea4-987176068365 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:55.444344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:55.445413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:55.445887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:55.446371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:55.447733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:55.448588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:55.450268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3101b6-562c-47a1-8366-4794ae496e4f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:55.457079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 358/700] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:39:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:55.749674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903814fc-d8df-48be-9e8f-38c05fab6ec7 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:55.750066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903814fc-d8df-48be-9e8f-38c05fab6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:55.750297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903814fc-d8df-48be-9e8f-38c05fab6ec7 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:55.751953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 343/701] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:55.757684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:55.757974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:55.758253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:55.775716 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:55.776970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:55.845933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:55.878409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 359/702] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:55.918938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903814fc-d8df-48be-9e8f-38c05fab6ec7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.094909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903814fc-d8df-48be-9e8f-38c05fab6ec7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.129038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.129839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.130112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.130380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.141633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d11de89a-7415-4f2a-87a3-7e4061513da6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:56.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:56.150351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:56.151235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:56.155376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 344/703] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:56.156966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.198178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcd75-3628-498a-a46c-abf832f8eb7b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.198458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcd75-3628-498a-a46c-abf832f8eb7b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.198733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64dcd75-3628-498a-a46c-abf832f8eb7b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.200245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 345/704] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:39:56.207711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.207995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.208270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.229779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:56.231366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:56.280011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:56.328477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 346/705] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 20 14:39:56.338172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bc0e-0bb7-4021-84d0-c1a3d0967e56 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.353546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.405465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.406152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.406435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.407416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.408181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:56.408489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:56.409910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:56.432642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 360/706] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:56.436857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.485945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:56.543392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afcc0c-a92b-46f1-9127-c038a61c7557 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.550638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff1788-cc6e-451a-8734-7a4d20ae444a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.578794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.579598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.579877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.580149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.591256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:56.593015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:56.610163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:56.611019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:56.611868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:56.611868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:56.611868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:56.611868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:56.611868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 361/707] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:56.619782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.631975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.632803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.633085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.633357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] PATH_INFO: `/v3/services/network` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.634013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:56.635400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:56.655311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:56.656317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:56.657232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 347/708] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:56.661806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.787075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:56.819924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:56.832754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699c6c7-7942-4995-bcf1-68274964e7d4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.834634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc40f9a-9aee-4272-a81f-840930f5e279 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:56.870614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.871474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.871597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.871842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.872589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:56.872998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:56.874554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d837f-5d9d-47dc-87d2-00405757f3c9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:56.877568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:56.878446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.878872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.879288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.880143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:56.880604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:56.882249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:56.887638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 362/710] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:39:56.887831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 348/710] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:56.892179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23009c-61e0-4ade-bdd9-613e0e970020 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:56.892179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23009c-61e0-4ade-bdd9-613e0e970020 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:56.892179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23009c-61e0-4ade-bdd9-613e0e970020 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:56.892179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 363/711] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:56.893482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23009c-61e0-4ade-bdd9-613e0e970020 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.893985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:56.997227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23009c-61e0-4ade-bdd9-613e0e970020 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.003496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec176b8-2f9c-4887-9d0d-4f2d2b9938e5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.005759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.033096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.033789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.034078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.034316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.035033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] RBAC: Adding query filter params (type=network) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:57.035338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.036803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3b0fb-6426-4964-8982-dec94e824be6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.045388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.046627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.047108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.047623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.049007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 364/712] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:57.050548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.050830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.051103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.058391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.060417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:57.077774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:57.078787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:39:57.079819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:57.082655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 349/713] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:39:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:57.090712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:57.090712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:57.090943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.112959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.222252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 365/714] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:57.235027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f979f50-e448-465c-93af-6a6f5a274f88 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.253252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.297334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.298264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.298944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.299231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.300363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:57.300678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.303334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.330114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 350/715] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:57.331431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.357154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.392094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401043b8-b9dd-4de6-a8ed-6b6310f22c50 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.445355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7e9d-c2c0-4dd8-90a4-637d32972964 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.483741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.484458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.484767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.485048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.489027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.489857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.490137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.490407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.518450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:57.535192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:57.536205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:39:57.537099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:57.538919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 366/716] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:57.542717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.569182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.632639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.634206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.679089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.723137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2986f-fb06-4b8c-b171-2747cfb916b3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.759326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.760009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.760293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.760570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.761366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:57.761675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.763066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.772835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 367/717] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:57.778449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.820454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 351/718] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:57.825609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.859247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.899684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15e436-dd30-4acd-8c18-5ff018bdcf79 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.935968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.936803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.937084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.937543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.946245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3633a2-17eb-46b6-9617-f329a692cc46 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:57.948747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:57.950177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:57.967253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-7977a674-1a07-4673-a359-82febd4c435b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:57.967859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:57.968700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:57.969951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:57.969951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:57.969951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:57.969951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:57.969951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 368/719] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:39:57.970483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fa409-5c6b-4dce-bc84-7a9af5c68d29 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.970576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fa409-5c6b-4dce-bc84-7a9af5c68d29 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.970836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04fa409-5c6b-4dce-bc84-7a9af5c68d29 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.972320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 369/720] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:57.976848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba300c-d028-432e-8ed9-5946db224186 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.976848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba300c-d028-432e-8ed9-5946db224186 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.976848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba300c-d028-432e-8ed9-5946db224186 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:57.976848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 370/721] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:57.976848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba300c-d028-432e-8ed9-5946db224186 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:57.991066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:57.991867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:57.992151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:57.992423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.003296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.004830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-efe5a86b-7d1f-46a1-8f3c-e1d94a913361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:58.025437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:58.026263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:58.027121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:58.027121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:58.027121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:58.027121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:58.027121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 352/722] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:58.028347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aebc-1039-4e7c-9ed9-21be51a7a6a1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.028693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aebc-1039-4e7c-9ed9-21be51a7a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.029108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9aebc-1039-4e7c-9ed9-21be51a7a6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.046216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0ac9aebc-1039-4e7c-9ed9-21be51a7a6a1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:58.047398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0ac9aebc-1039-4e7c-9ed9-21be51a7a6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:58.095448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba300c-d028-432e-8ed9-5946db224186 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.116188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 353/723] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:58.118367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.118662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.118939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.121370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.133414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.134370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.134865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.135354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.136269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:58.136800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.138429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.142717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:58.143907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:58.151464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 371/724] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:58.152080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.216314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 354/725] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:58.217526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.253758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.261565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5a7e-8f53-496f-b53b-040db4afe6c9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.295471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.296131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.296407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.296677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.297426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:58.297729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.299089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.310812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 372/726] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:58.315754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.323693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96e747-f665-48e4-a4f7-ad753461d58d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.359402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.360197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.360476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.360784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.361044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.371626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:39:58.379582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:58.380584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:58.381463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 355/727] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:58.382795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.423754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119a611-238e-4d01-980e-8e9478de5bc9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.459572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.460395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.460672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.460973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.469083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.470519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.484044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:58.485787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:58.486700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:39:58.487621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:58.491458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 373/728] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:58.492300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.498390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8012db4-aba4-4480-aa18-8bad888ca961 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.534921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.535590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.535871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.536141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.536888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.538293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.554576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 356/729] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:39:58 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:58.555285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.635280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ec93-4370-44f1-82af-b4d01f06d892 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.638805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.689686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f9822-8101-4acc-8712-4d8bcfc3b81c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.693056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.695158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.695640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.696088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.706683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.709235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:39:58.730299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:58.731203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:58.732522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 374/730] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:58.733049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.733768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.734450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.734785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.735079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.736056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:58.741736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.741736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.750444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 357/731] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:58.751246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.768111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:58.867850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14aa4a-71b2-48be-9298-e14822aeb4c1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.891287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965e41c-105a-4243-831f-f2f04a6b823d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:58.905196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.906583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.907326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.907797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.909033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:58.909916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.911856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.934709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:58.939328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:58.939328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:58.939328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:58.939328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:58.939328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:58.939846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:58.940253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 375/732] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:58.941735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.960793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 358/733] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:58.961965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:58.970380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.062145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.094093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca4a6c-840e-4784-9575-c231bb2ca434 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.096266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a61fa-4b4e-429b-b8b5-3d478844636b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.132376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.133208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.133641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.133916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.144958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.146619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.147153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.147818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.148103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.148380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:59.172316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:59.173307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:59.174180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:59.174180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:59.174180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:59.174180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:39:59.174681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 376/734] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:59.180742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.241073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.243053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2464b5-48ff-4978-a622-28219dd89d55 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.266286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.303464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75a2d-820a-4b57-ae9e-dda3d22e14d8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.336098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.340636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.341327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.341658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.341919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.342755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:59.343060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.344761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.350488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 377/735] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:59.351283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.377409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 359/736] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:39:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 20 14:39:59.379276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108913c4-def7-47d0-850f-0041a15462c3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.379798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108913c4-def7-47d0-850f-0041a15462c3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.380298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108913c4-def7-47d0-850f-0041a15462c3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.382592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 360/737] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:39:59.383852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108913c4-def7-47d0-850f-0041a15462c3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.479766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3d95a-a5a5-4205-8b65-0bdbea03916b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.506934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108913c4-def7-47d0-850f-0041a15462c3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.519267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.519957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.520245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.520525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.521536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:59.521765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.523158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2eee63-5090-4524-bfb9-02e59dc9fd1a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.525079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.537424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 378/738] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:59.538955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.539486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.539596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.551498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.552791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.553292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.553778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.557952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:39:59.559251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:39:59.565902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.568092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:39:59.588209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:59.589392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:59.590322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:39:59.590322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:39:59.590322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:39:59.590322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:59.590998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 361/739] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:59.592199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.630732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.636959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 379/740] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:39:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 20 14:39:59.638138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.719301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd21b-ca7e-4ed6-873a-0a35a234cc42 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.759556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.760680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.761188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.761641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.770706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.772603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.784638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3d92a-f439-4636-8d2d-7a9bd7f2c783 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:39:59.789231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:39:59.790156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:39:59.791113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:39:59.793468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 362/741] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:39:59.794592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.813219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.826911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.827976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.828257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.828529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.829555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:39:59.829860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.831886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.847476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 380/742] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:39:59.848642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.888321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:39:59.910115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f099a3d-2a2f-4cef-bbac-5a8d7c20bba4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:39:59.949349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:39:59.950299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:39:59.950828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:39:59.951249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:39:59.952185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:39:59.953847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:39:59.974961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 363/743] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:39:59 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:39:59.974961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:39:59.992881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e9161-fb4f-40a0-ac14-10e593978252 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.039755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.040702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.041179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.041590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.042595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:00.043068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.045036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.080528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 381/744] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:00.086270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.158890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.190915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b7e1d-fd45-4256-9a3a-7287b24d569d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.230313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.231122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.231419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.231774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.235800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33715053-d533-4236-9cdb-a93a1d967cb4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.239958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.241466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:00.256878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:00.257820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:00.258698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 364/745] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:39:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:00.264993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.270618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.276189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.277469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.278031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.278510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.349733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.351531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.373243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f37765-fc0b-4314-bc6b-10634f1cee9f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.396104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.426578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.427251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.427532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.427805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.428608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:00.429358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.431698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.447900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 365/746] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:00.453939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.470159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 382/747] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 14:40:00.477875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.538227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.581259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85a61d-ea96-4168-8d87-ecc7e18cdf8d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.595705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb061d-f740-4902-b173-3caa12366d4f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.634133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.634946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.635226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.635495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.650180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.651672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.661414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.661584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.662146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.662432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.662704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.663547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=d833fa0454b14478b733e0e21e559b2b) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:00.663860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.665354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb6d1b-e333-407f-8457-236ed27a0dc2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:00.671134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:00.672015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:00.673012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:00.673012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:00.673012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:00.673012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:00.673012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 383/748] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:00.678182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.679611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 366/749] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/role_assignments?user.id=d833fa0454b14478b733e0e21e559b2b&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:00.774749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bece8a-1c1b-44d5-b683-29d6afbee333 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.775167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bece8a-1c1b-44d5-b683-29d6afbee333 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.775281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bece8a-1c1b-44d5-b683-29d6afbee333 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.776929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 367/750] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:00.785349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be7453-38ca-49b9-8d67-aefead64db2a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.790763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.791039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.791239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.826623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:00.827315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:00.827597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:00.827875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:00.828627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:00.829065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:00.830410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:00.836790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:00.838034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:00.843217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 384/751] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:00.852928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:00.935631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:00.959052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 368/752] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:00.989178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8aa69-558d-402f-8abb-b412bc02c9b4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:00.994187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.030080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.031722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.031722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.031722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.042670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.044063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:01.075122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:01.076136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:01.077177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 385/753] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:01.083592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.099901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:01.146784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6334e62-d0c0-4256-bd4c-1a91111f73fa None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.184978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e430-277d-42d9-b079-415762f87601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.186394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e430-277d-42d9-b079-415762f87601 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.186673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e430-277d-42d9-b079-415762f87601 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.187208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666e430-277d-42d9-b079-415762f87601 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.187867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666e430-277d-42d9-b079-415762f87601 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.189525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666e430-277d-42d9-b079-415762f87601 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d666e430-277d-42d9-b079-415762f87601 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:01.203856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:01.206480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:01.208385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 369/754] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jun 20 14:40:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:01.216225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e430-277d-42d9-b079-415762f87601 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.256444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c18001-ecef-4a03-880c-36a68da94b4a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.268186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:01.303574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.305056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.305533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.306035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.307036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:01.307604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.309369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.331895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 386/755] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:01.337139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.426625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666e430-277d-42d9-b079-415762f87601 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.469064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:01.506114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c18d9-01ce-472e-90c3-33c56fda1e7d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.537428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.538106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.538384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.538653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.539399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:01.539667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.541087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.550316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.550982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.551266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.551543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.552392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=b96d8006e32d48379aba33d842b0f000) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:01.552703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.554216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534c692-0e93-4920-896b-c6e3bbece4c5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.555586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 370/756] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:01.556516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.573658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 387/757] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/role_assignments?user.id=b96d8006e32d48379aba33d842b0f000&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:01.693517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b141f-6e0f-4a35-ab86-3f5b609a6321 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.693875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b141f-6e0f-4a35-ab86-3f5b609a6321 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.694060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b141f-6e0f-4a35-ab86-3f5b609a6321 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.695653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 388/758] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:01.703988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.704291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.704543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.723830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe23f3-18f1-446c-84c7-048465cf9160 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.733814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:01.735056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:01.764068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.764771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.765058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.765331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.766047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:01.766355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.767757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.781385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 371/759] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:01.786307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:01.787306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.857575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:01.890433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 389/760] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:01.913936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342856-c3b1-45e4-bc38-ec07958fa3c8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:01.930743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:01.958150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:01.959227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:01.959692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:01.960100 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:01.961472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] RBAC: Adding query filter params (interface=public, service_id=df101e4914ab4a46b79cbf3fb5936eab, region_id=RegionOne) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:01.961929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:01.964211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:01.979248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 372/761] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/endpoints?service_id=df101e4914ab4a46b79cbf3fb5936eab&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:01.981150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:02.153057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc14c9-8d6b-4c2e-90c5-c284120a91be None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:02.157694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c542-2f5d-4b57-9832-cd01856fd47d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:02.185065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:02.196255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:02.196956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.197245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.197526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.198217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:02.200381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:02.206523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 373/762] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:02.225357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:02.226343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.226737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.227108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.240191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:02.248405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:02.249446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:02.250503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 390/763] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:02.258170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:02.403806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebf6f4-614f-4910-890c-4eb2d6c7ad5f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:02.444182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:02.445419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.445917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.446400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.447354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:02.447852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:02.449448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:02.461198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 374/764] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:02.465099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:02.494772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:02.577315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5a901-b72f-47af-bd2b-56b552a90c78 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:02.618058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:02.618861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.619140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.619411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.634712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:02.636173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:02.657898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:02.658817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:02.659682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:02.659682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:02.659682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:02.659682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:02.659682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 391/765] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:02.669950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:02.722124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:02.800150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739881e8-f15e-418e-974c-4ce1aedb631e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:02.840211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:02.841318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.841930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.842615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.843552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:02.844055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:02.845678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9830b6-5dc3-4b0c-8334-d9439529663b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:02.862700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 375/766] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:02.868143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:02.963617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5df3-db0e-447c-aaa7-1981f751cbd9 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.964497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5df3-db0e-447c-aaa7-1981f751cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.965028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f5df3-db0e-447c-aaa7-1981f751cbd9 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.967742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 376/767] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:40:02.974813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb933-e698-42eb-bd7b-96b5b9145c10 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:02.975381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb933-e698-42eb-bd7b-96b5b9145c10 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:02.975858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fb933-e698-42eb-bd7b-96b5b9145c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:02.981574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.011062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-604fb933-e698-42eb-bd7b-96b5b9145c10 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:03.012283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-604fb933-e698-42eb-bd7b-96b5b9145c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:03.027619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1540ff-de62-4a56-aa4f-468bb1147289 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.066239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.068171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.069100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.069856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.082607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.084068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.096156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 377/768] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:03.097835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b109-aad8-415c-899c-50b7d6dc5896 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.098317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b109-aad8-415c-899c-50b7d6dc5896 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.098798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3b109-aad8-415c-899c-50b7d6dc5896 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:03.106155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:03.107300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:03.108352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 392/770] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:40:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:03.109157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 378/770] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:03.110308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.113353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.113646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.113937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.130953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:03.132134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:03.156298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.209094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 379/771] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:03.209094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.260220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae497e-273a-4429-8d60-ef84a7ffe294 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.298114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.298788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.299066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.299337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.300171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:03.300476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.302174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.305770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.329257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 393/772] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:03.330079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.332538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa257e-1d74-4e4b-9203-92ed300f58cc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.377746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.379082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.379950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.380629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] PATH_INFO: `/v3/services/network` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.381609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.383716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:03.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:03.401586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:03.402492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:03.405330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 380/773] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:03.407229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.438227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176d122-65bd-4a67-b761-23d3a13debbf None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.439503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.480753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.482928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.483360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.484022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.498551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:03.508767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:03.509875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:40:03.510943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:03.513858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 394/774] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:03.514805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.537757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08721366-67c6-48b9-8bab-8af0faca1892 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.578753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.588837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.589872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.590299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.590713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.603253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.604988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:03.623212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:03.624316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:03.625255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:03.625255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:03.625255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:03.625255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:03.630200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 381/775] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:03.631198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.636551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774174a5-d314-41ec-869a-23536f26fe43 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.678218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.679590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.680085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.680537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.681811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] RBAC: Adding query filter params (name=network) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:03.682305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.684570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.691936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 395/776] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:03.693160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.732895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.771436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8b50-5853-47af-8885-53f8dccc937b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.808286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.808815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.809103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.809379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.810201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:03.810597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.811993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.818870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb419f-26f6-442c-9216-1beaac32cd65 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.820983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 382/777] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:03.822334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.837798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.856550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.857625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.858052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.858509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.859374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:03.859813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.861404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.874034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 396/778] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:03.875138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.925777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5d0aa-42ee-41a4-a779-b588a0fd46e0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:03.961207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:03.961887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.962166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.962436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.963151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] RBAC: Adding query filter params (type=network) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:03.963457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:03.964908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eabdf06-ed0d-4f4e-8207-f0895766dc9e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:03.967411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:03.971266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 383/779] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:03.972523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbd0f-56f2-42d2-b5cb-b891ca27e14f None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:03.972841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbd0f-56f2-42d2-b5cb-b891ca27e14f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:03.973545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbbd0f-56f2-42d2-b5cb-b891ca27e14f None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:03.979435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 384/780] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:03.980282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbbd0f-56f2-42d2-b5cb-b891ca27e14f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:03.988745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dfb9a-ba19-4f01-afed-66651475b4bb None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.029030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.029862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.030146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.030418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.041995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.043443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:04.061383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:04.062290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:04.063156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:04.063156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:04.063156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:04.063156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:04.067406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 397/781] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:04.068204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.097400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbbd0f-56f2-42d2-b5cb-b891ca27e14f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.100734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.133466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.134261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.134540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.134809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.142266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.143735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0341dc0e-b27e-4891-af43-07fcd191d3ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:04.159084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:04.159995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:04.160896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 385/782] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:04.161854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.161854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.162039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.176340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba49d1-8af2-4fae-b380-6eb9c901b23c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.179513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:04.180778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:04.211178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.211849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.212134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.212408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.213234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] RBAC: Adding query filter params (interface=public, service_id=34ae732a52e740f1b9e51e6695c4250e, region_id=RegionOne) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:04.213547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.214950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.227318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 398/783] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/endpoints?service_id=34ae732a52e740f1b9e51e6695c4250e&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:04.227318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.244260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.258598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 386/784] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:04.261587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.328213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.334778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32a327-9979-4aa2-8f7d-b1e24f5159fd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.370620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.371296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.371579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.371854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.372375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac83d87-8be1-4fc1-8900-c4f1f3a22c2b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.372605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:04.372964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.374346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.389742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 399/785] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:04.390688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.412211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.413003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.413356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.413704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.414560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:04.415001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.416547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.428634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 387/786] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:04.429573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.482452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.508884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f571b9a-9d67-40ed-aa34-58704b0b49a8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.537712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c76640-e9a5-4e94-b9ae-184c0ba7effd None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.544430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.545268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.545652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.546023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.546802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.548296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.560748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 400/787] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:04.560748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.579119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.588531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.589493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.589838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.590182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.603172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:04.613190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:04.614384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:04.615423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:04.621608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 388/788] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:04.622824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.674115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7f32f-62f5-446f-a315-d0ffab2e14cb None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.713880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.715094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.715524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.716015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.726041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.727507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.739496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fcc5a-9827-4325-9dbb-0f3abb0fa135 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-8b7915cb-3aeb-4453-88a2-c07b735dc775 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:04.744873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:04.745955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 401/789] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572885af-8e3e-4bf2-9dfa-b9e5867de0f7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.749018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572885af-8e3e-4bf2-9dfa-b9e5867de0f7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.749725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572885af-8e3e-4bf2-9dfa-b9e5867de0f7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.751395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 402/790] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:04.751395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572885af-8e3e-4bf2-9dfa-b9e5867de0f7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.755901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.777713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.778778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.779263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.779588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.781817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=644364ac21704f9281845a8af6fa0b30, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.783376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.797801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 389/791] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:04 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:04.798842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:04.854933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:04.888893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572885af-8e3e-4bf2-9dfa-b9e5867de0f7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.934532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.935740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.935740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.936238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.937148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:04.937550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.939099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954464b-b7ef-48c3-beca-8c796877ba43 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:04.939416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad1ad-2cfa-407f-ae59-682eafbd54a8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:04.954555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 403/792] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:04.956314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.956608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.957004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.980688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:04.982177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:04.986588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:04.987268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:04.987546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:04.987817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:04.988658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:04.988996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:04.990446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.018156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 390/793] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:40:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.022747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.055514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.078726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 404/794] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:05.080591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.135007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44e08f-4a78-48e9-822d-4bac278523e4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.158890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.170297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.171242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.171618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.172024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.182775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.184280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.194656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bfd53-b123-49a1-9a7e-3c36c2528031 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:05.204696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:05.205778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:05.206849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:05.206849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:05.206849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:05.206849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:05.208417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 391/795] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:05.209338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.234602 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.235769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.236292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.236701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.248166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.250009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:05.269811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:05.270769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:05.271637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:05.271637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:05.271637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:05.271637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:05.273600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 405/796] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:05.274607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.300109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.320553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537324e-4c7f-40f6-9ef5-a490d93c9298 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.356414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.357644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.357924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.358246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.359476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.360410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:05.373763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:05.374730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:05.375559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 392/797] 10.222.0.23 () {56 vars in 1129 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:05.376398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.393007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d9b0-8c9d-43ce-9c8b-8b94c2d44b2d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.427643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.428565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.429027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.429443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.430348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:05.430860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.432411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.441123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.444843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 406/798] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.445959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.482616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6a141-b2f9-4c53-bd0b-21be0899cfc4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.517980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.518192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.518590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.518929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.519721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:05.520088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.521575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.538950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 393/799] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.540015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.543906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.550371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80cc5e-738b-4195-9630-e2fb22f26283 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.585234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.585868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.586197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.586475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.587188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:05.587550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.588986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.594218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 407/800] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.595326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.645200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.651216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f77983-12cc-4611-9ad3-abe5e5cfa9e8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.685957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.687058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.687508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.687977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.695714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.697412 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.706998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3887e98-80d0-4005-92f9-58db3237f204 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:05.713674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:05.714578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:40:05.715520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:05.718530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 394/801] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:05.719527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.756533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.757369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.757648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.757920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.765219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.766672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:05.781718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:05.782617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:05.783482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:05.787755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 408/802] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:05.788630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.789055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.832900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c0471-22ef-4c68-8ea3-e95e65002d09 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.871041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.872012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.872598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.873079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.874053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:05.874549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.876159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.882036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 395/803] 10.222.0.23 () {56 vars in 1124 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.883082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.893695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb80b32-f679-4937-ad79-8eda258fb8c4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:05.901494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:05.930234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:05.930937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:05.931221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:05.931496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:05.932448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:05.932796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:05.934384 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:05.959115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 409/804] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:05.960152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:05.995197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a982ab5-7571-4c6e-b56e-4b56224d1e59 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.031744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:06.041027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.042008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.042463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.042917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.043977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:06.044587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.046324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.059580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 396/805] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:06.061004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.073522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8731118e-1d35-462c-9323-b8da99212c44 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.110927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.111597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.111951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.112466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.113297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.115302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.141997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 410/806] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:06.143392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.171504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:06.185863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074ac8-0c3c-4dc8-a1c0-b3a8dc2acb95 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.239843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.240672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.240987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.241265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.257871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.260033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.268337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189b6a-244d-4e2c-bdf7-f9d35a959d8e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:06.284391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:06.285389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:06.286282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:06.286282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:06.286282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:06.286282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:06.286282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 397/807] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:06.291810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.310877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.312106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.312525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.312985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/d833fa0454b14478b733e0e21e559b2b/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.330404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=d833fa0454b14478b733e0e21e559b2b, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.332140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.333580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:06.347980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 411/808] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:06 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/d833fa0454b14478b733e0e21e559b2b/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:06.430185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd01d4-b619-431a-ad2a-8e4c2396207f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.468965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.469652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.469934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.470209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.470950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:06.471258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.472672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.487071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 398/809] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:06.492665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.576001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:06.609376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0452-a030-45a9-8ba6-d697a2998fbe None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.644171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.645107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.645460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.645799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.652854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.654676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:06.668642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:06.669818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:06.670882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:06.672747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 412/810] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:06.678059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.779686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:06.786424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb85cd8-2873-476a-9996-f12c2b20c661 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:06.821884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:06.822701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.823056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.823400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.824273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:06.824650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:06.826960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b0bc2-72cd-4bd6-9ad0-adc6c9e1823a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:06.841406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 399/811] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:06.847506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:06.918059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2497be-9373-4206-8c01-bae4bcd3a8ab None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.918439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2497be-9373-4206-8c01-bae4bcd3a8ab None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.918784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2497be-9373-4206-8c01-bae4bcd3a8ab None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.920845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 400/812] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:06.926075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c159-d582-41f1-a891-77e68277e836 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:06.926439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c159-d582-41f1-a891-77e68277e836 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:06.926785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8c159-d582-41f1-a891-77e68277e836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:06.951279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d4a8c159-d582-41f1-a891-77e68277e836 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:06.954000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d4a8c159-d582-41f1-a891-77e68277e836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:07.011606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36630-e4cc-4e15-ad20-1f4d974ca440 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.059866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.061151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.061603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.061995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 401/813] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:07.062423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/b96d8006e32d48379aba33d842b0f000/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.063354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed93a-2074-477b-a6f6-183882489405 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.063731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed93a-2074-477b-a6f6-183882489405 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.064100 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ed93a-2074-477b-a6f6-183882489405 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.065246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=b96d8006e32d48379aba33d842b0f000, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.067266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:07.070121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 402/814] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:07.071331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.071690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.072214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.073178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.085224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 413/815] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:06 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/b96d8006e32d48379aba33d842b0f000/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:07.093295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:07.094666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:07.101824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.176743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 403/816] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:07.194655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.214011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.286675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4188479-cda0-4529-a494-48fb2061ff2c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.302763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0df144-6645-491b-8d53-5faade4b1681 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.339774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.341545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.342049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.342529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.354018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:07.356265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.357143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.357428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.357702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] PATH_INFO: `/v3/services/network` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.358373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.359754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:07.363808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:07.364766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:07.365637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:07.368448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 404/817] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:07.374719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:07.390229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:07.391280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 20 14:40:07.392088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:07.401191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 414/818] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/services/network => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:07.406996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.473873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.488909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.526717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6899b3-9a52-4d43-a6bf-c22c346033e3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.538754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8542a-1435-41ec-9688-19665076d9c6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.575757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.576823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.578054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.578506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.579386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] RBAC: Adding query filter params (name=network) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:07.579864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.581941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:07.587281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 415/819] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:07.593895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.646105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.646882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.647232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.647572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.648415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:07.648809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.650227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:07.672753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 405/820] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:07.686660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.714127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df4891-6874-40f0-91da-8adc7744ce24 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.745148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.754280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.755261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.755733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.757189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.758100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] RBAC: Adding query filter params (type=network) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:07.759710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.763400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:07.775144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 416/821] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:07.781051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:07.908945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c680-31cf-4091-a48b-829424a3617c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:07.963862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:07.965083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:07.965584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:07.966359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:07.974743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:07.979797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:07.981516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:08.000292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:08.001278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:08.002148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:08.002148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:08.002148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:08.002148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:08.004449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 406/822] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:08.010149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:08.170483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27440aa5-a0c9-4fb3-9907-d7c9361d286e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:08.215104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:08.216126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.218004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.218482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.219437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:08.220906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:08.224211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:08.250729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a08eca-32a8-497e-98f8-9d3eca54aceb None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:08.265061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 407/823] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:08.281794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:08.308996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:08.309662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.309969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.310247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.310995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:08.312375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:08.348911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 417/824] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 568 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:08.373875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:08.453705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1870da-fdcf-4afe-8708-e59b8b322a09 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:08.517896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:08.518713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.518995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.519270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.527086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:08.528580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e241ca05-ce63-4d36-8fa7-d8cdd0b95f74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:08.544823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:08.545746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:08.546687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 408/825] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:40:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:08.553405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:08.596460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:08.660142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63766b79-1dfe-457b-97b8-2bf0ef124d03 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:08.665600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30609cb-b0af-4421-9be4-246cd92a5bd7 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.665915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30609cb-b0af-4421-9be4-246cd92a5bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.666149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30609cb-b0af-4421-9be4-246cd92a5bd7 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.667950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 409/826] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:08.673912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c73d-7f15-4965-a784-e8c36bda3ba1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.674250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c73d-7f15-4965-a784-e8c36bda3ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.674466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117c73d-7f15-4965-a784-e8c36bda3ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.700248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9117c73d-7f15-4965-a784-e8c36bda3ba1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:08.701932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9117c73d-7f15-4965-a784-e8c36bda3ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:08.703972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:08.704920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.705375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.705815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.706826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:08.707323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:08.708972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:08.730318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 418/827] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:40:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:08.738962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:08.807324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 410/828] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:08.808879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894b5e-b78a-4267-929e-b1384a8c4ed5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.809260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894b5e-b78a-4267-929e-b1384a8c4ed5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.809629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894b5e-b78a-4267-929e-b1384a8c4ed5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.811448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 411/829] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:08.816938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.817221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.817491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.834976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:08.836152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:08.847868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:08.853799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee1c10-c2cd-4745-b279-69eca01efa83 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:08.866499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:08.891376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:08.892033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:08.892315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:08.892588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:08.911022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 412/830] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:08.912094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:08.967750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:08.969506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.020970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3480e-66b2-4046-85e6-bd7de28eeb8f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.059094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.059903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.060244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.060618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.072002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:09.075073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:09.080201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.081394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.082332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 413/831] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:09.083123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.089058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 419/832] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:09.090275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.116197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.193759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae50a4-dad5-48bc-ae95-c3aada8f4bb1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.203028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe96e-68c8-4a04-8cda-f69c726a035c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.229909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.230638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.230918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.231191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.231893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.233338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.240131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.240830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.241117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.241390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.242141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:09.242447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.243798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.245749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.246685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.247555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 414/833] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:09.248353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.262818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 420/834] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:09.262818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.322890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.347895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.358804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c035f08-c29d-456a-9b72-1256d773ab84 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.368277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c39581-bffc-42d0-9a11-514faa849662 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.394497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.396549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.397017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.397296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.403079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.403837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.404581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.404581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.405294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:09.405600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.407117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.409575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.411028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.411834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 421/835] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:09.412353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:09.433494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.434465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 415/836] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:09.436964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.518833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a171593-dfb4-402f-9e09-9fb18ff4f986 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.540920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.546706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af757c5-c3df-4c1f-9908-f1a4e2d28385 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.552683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.553508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.553789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.554062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.565247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.567008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:09.584689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.585648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.586510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:09.586510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:09.586510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:09.586510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:09.586510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 422/837] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:09.586791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.587566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.588485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.589004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.589503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.590492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:09.590815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.593041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.608006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 416/838] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:09.608006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.618630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.722872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d749f74-be97-440e-96d2-9e449851f6fb None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.725743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea934c-416e-4b1a-aff8-cd97da5156fb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.762680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.763438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.763717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.763995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.765798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.765938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:09.765938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.766092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.766092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.766092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.766436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d992678-a2ba-4fe3-822f-2994fdcde47c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.766545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:09.766802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.770052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.780272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 423/839] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:09.781813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e04-bfdf-4079-a6eb-2914475bab0e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.782113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e04-bfdf-4079-a6eb-2914475bab0e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.782390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef89e04-bfdf-4079-a6eb-2914475bab0e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.783758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 424/840] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:09.784111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 417/841] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:09.788582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89e04-bfdf-4079-a6eb-2914475bab0e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.789392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.827387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.860252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:09.898824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a80dd8-7200-443a-af1a-811272f5853c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.900502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef89e04-bfdf-4079-a6eb-2914475bab0e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:09.936656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.937510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.937789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:09.937903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.938064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.938707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.939051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.939399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.946412 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.946819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:09.947904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.948297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-58f6e9f1-9ae5-4868-b19a-ad19112c51ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:09.962333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.963499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:09.964378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 425/842] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:09.964971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:09.965039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:09.965262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:09.967671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:09.968582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:09.969568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 418/843] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:09.970207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:09.986598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:09.987849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:10.058638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 426/844] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:10.062214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.089974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de714ee0-e341-47b0-ab1a-03b0a94ae761 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.095738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.119263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.128833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.129500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.129783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.130056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.130849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:10.131172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.132766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.145525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 419/845] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:10.146077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.181461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7e7c1-d517-4f94-840e-e472fd4ed375 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.225625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.226308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.226586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.226856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.227696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:10.228006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.229480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.251566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 427/846] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:10.252677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.258867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ebf4d-ea58-492c-952f-eafc0b1e4071 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.296348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.297107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.297388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.297660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.308956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:10.317793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:10.318697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:10.319513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:10.324031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 420/847] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:10.324934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.338422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.358322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b9fa-7dd7-430e-a5d4-eef1a925dbb5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.375897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.400366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.401857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.402145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.402421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.403303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:10.403622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.405467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.412523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 428/848] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:10.413347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.448244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e281ccf-442b-4c6e-be3a-6cf8c420a4a5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.485296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.485964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.486243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.486515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.558808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebfd4-5f46-4cdb-9429-4aeaab96ba5f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.581870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.583138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.605103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.605772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.606049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.606327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.607182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:10.607712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.608894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.620881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 429/849] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:10.626265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.640273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.642554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.711074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 421/850] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:10.719140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.758404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bfb532-868a-4884-b531-a4350f4cdff1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.804703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.805724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.806099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.806465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.818723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.820048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.838154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e6c9f-4ad4-400f-8a3a-def448e1b1b5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:10.844276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:10.845380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:10.846472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:10.846472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:10.846472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:10.846472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:10.848867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 430/851] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:10.853768 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.893982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:10.895295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:10.895994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:10.897373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:10.913025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:10.914556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:10.921801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.926896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:10.934971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:10.935851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:10.936926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:10.936926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:10.936926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:10.936926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:10.943262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 422/852] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:10.944613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:10.983350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3eb61-90fd-41a6-af7e-6995195b9eff None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.021061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.022071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.022582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.023020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.025832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:11.026478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.028112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.042045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 431/853] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:11.048835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.072300 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b17fbe-c591-485a-98f3-37719e47cdfa None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.109672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.110672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.111171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.111618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.112553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:11.113076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.114650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.131346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 423/854] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:11.132555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.173861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3c6b-f225-4f89-9308-43f4cc3bc54e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.198634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.218470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.219295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.219581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.219861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.228551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.230062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:11.246565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:11.247618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 20 14:40:11.248577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:11.252839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 432/855] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:11.254739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.342552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.361665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cca5-8969-4222-b9cf-52ec90d14809 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.392594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516b918-489d-4839-822f-d3981e697a9c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.405546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.406233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.406613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.406897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.408103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:11.408212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.409607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.429198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.430378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.430849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.431321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.432796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 433/856] 10.222.0.23 () {56 vars in 1135 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:11.436443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.441759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.443465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:11.458244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:11.459562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:11.460451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:11.467728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 424/857] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:11.468834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.480244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.552520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8041e57-043b-4b73-b1da-67bb148d757b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.578871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431482d-2fe1-42d2-a010-3987c9b89e3d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.590452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.591115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.591693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.592321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.598187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.616343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.617467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.617996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.618470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.619560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:11.620130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.621907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.640637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 425/858] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:11.641936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.672630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.674235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1723bc-1c74-4871-bc9c-81d145603346 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.716524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.750419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f883f-5a34-4b26-b935-244aa11858fc None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:11.788455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 434/859] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:11.788455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59109-af19-4f29-95b5-58461c7e1703 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.788455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59109-af19-4f29-95b5-58461c7e1703 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.788455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59109-af19-4f29-95b5-58461c7e1703 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.788455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 435/860] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:11.792013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59109-af19-4f29-95b5-58461c7e1703 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.792933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:11.793629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.793913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.794188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.795255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=d833fa0454b14478b733e0e21e559b2b) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:11.795575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:11.797075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f554fa-3e96-4586-b421-87ab100009e6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:11.803523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 426/861] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/role_assignments?user.id=d833fa0454b14478b733e0e21e559b2b&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:11.804737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:11.805034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:11.805312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:11.823695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:11.824984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:11.865048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:11.908749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 427/862] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:11.931957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:11.965940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c59109-af19-4f29-95b5-58461c7e1703 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.014185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.015673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.017034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.017526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.025874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:12.040508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.042026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.059199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab2667-cb13-466f-b7d8-28826c0ba726 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:12.064683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:12.065853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:12.067319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:12.067319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:12.067319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:12.067319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:12.067583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 436/863] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:12.073123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:12.104771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.105990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.106426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.107065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.108351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.110357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.127583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 428/864] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:11 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:12.189300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47910a-1ba5-4678-a10d-693d7e35b5f3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.241134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.241816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.242105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.242380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.243116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:12.243422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.244857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.259265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 437/865] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:12.266000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:12.302136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:12.376453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a67-0539-42a8-a2cd-7fba08787c65 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.412167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.412918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.413196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.413463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.421070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.422535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b41754df-1f7b-46dd-b091-df48a9899b22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:12.437561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:12.438493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:12.439368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 429/866] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:12.445244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:12.493530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:12.548706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46443ee9-d7af-4a21-86f4-020e70aef27d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.579273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2abe5-671b-4466-8ae8-95855b9a3f43 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.579804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2abe5-671b-4466-8ae8-95855b9a3f43 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.579804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2abe5-671b-4466-8ae8-95855b9a3f43 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.581446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 430/867] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:40:12.584359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.585161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.585454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.585775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.586259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.586541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.586644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:12.586812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.586917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.588272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.601590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 438/868] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:12.606464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:12.607901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:12.609702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:12.700756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 431/869] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:12.718031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:12.727740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d96a4f-9e66-478b-9f66-e00d5645e45f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.736265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:12.746330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:12.784786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.786009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.786607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.787083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.788158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=b96d8006e32d48379aba33d842b0f000) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:12.788854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.791048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.803908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 439/870] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/role_assignments?user.id=b96d8006e32d48379aba33d842b0f000&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:12.833644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc60367-a70a-4ceb-8151-aee77bfdc697 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:12.871215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:12.872058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:12.872456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:12.873035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:12.873577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:12.875006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:12.889287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:12.890331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:12.891167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 432/871] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:12.899050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:13.032158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcdb990-8783-4862-9736-b29c0ae28b26 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:13.077399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:13.078077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:13.078362 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:13.078639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:13.079361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:13.079666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:13.081094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2078cb6-795c-4229-9739-cfed6ff5b6e2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:13.086739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 440/872] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:13.093277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:13.194145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:13.207169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3dd1b-bc28-4bd5-97b7-163e9017de29 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:13.241478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:13.242145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:13.242423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:13.242692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:13.243405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:13.243704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:13.245115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f3d8a-bec8-412f-8cb0-ac50d74b7407 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:13.250099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 433/873] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:14.020235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b1db-7899-435c-b5eb-2156a978a0d9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.020787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b1db-7899-435c-b5eb-2156a978a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.026577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b1db-7899-435c-b5eb-2156a978a0d9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.028490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 441/874] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:14.034215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941277-0322-44b4-a757-e5fbb6117587 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.035047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941277-0322-44b4-a757-e5fbb6117587 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.035525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2941277-0322-44b4-a757-e5fbb6117587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.052629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b2941277-0322-44b4-a757-e5fbb6117587 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:14.054179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b2941277-0322-44b4-a757-e5fbb6117587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:14.122741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 434/875] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:14.146177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069b1db-7899-435c-b5eb-2156a978a0d9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.183825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:14.253999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069b1db-7899-435c-b5eb-2156a978a0d9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.288942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dd473-91f9-4356-af44-b01153784090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.290103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd473-91f9-4356-af44-b01153784090 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.290603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd473-91f9-4356-af44-b01153784090 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.291069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dd473-91f9-4356-af44-b01153784090 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.301850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dd473-91f9-4356-af44-b01153784090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-176dd473-91f9-4356-af44-b01153784090 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:14.310454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:14.311417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:14.312242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:14.314961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 442/876] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:14.319943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883c74-bc3c-4ea0-9f6c-40c69eb01df1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.319943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883c74-bc3c-4ea0-9f6c-40c69eb01df1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.319943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16883c74-bc3c-4ea0-9f6c-40c69eb01df1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.320829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 435/877] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:14.321920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dd473-91f9-4356-af44-b01153784090 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.324647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.324977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.325251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.342267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:14.343803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:14.424798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 436/878] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:14.434920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:14.442664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dd473-91f9-4356-af44-b01153784090 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.447911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.477132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:14.489533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.490235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.490649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.491057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.491827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:14.492136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:14.493577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:14.504531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 443/879] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:14.510153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.581921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b427809-346f-4c27-be62-a82ef83670b5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.616666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.617554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.617836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.618107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.618763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:14.620203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:14.630769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad25f-11d9-4f18-8e9b-37441785c70a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:14.632637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:14.633642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:14.640376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 437/880] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:14.644950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.674457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.676288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.677055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.677656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.693414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:14.695811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:14.718681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:14.719623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:14.720520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:14.720520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:14.720520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:14.720520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:14.724693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 444/881] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:14.725583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.730126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:14.737820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:14.767140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d57119-4866-471c-808d-1daf6c02ee96 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.822894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.824004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.824984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.825587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.826760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:14.827504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:14.829802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:14.841293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889937-120e-49c6-9970-fa76814c6675 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.842186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 438/882] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:14.844670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.877344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:14.878040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:14.878496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:14.878615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:14.879342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:14.879579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:14.881140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:14.899082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 445/883] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:14.900065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:14.965135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd40c-e25b-40d5-89ed-c47e7fe83aee None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:14.971538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.001949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.002615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.002896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.003174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.003877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:15.004184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.005628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003c18-baaa-47c6-8a9e-65c2f15608dc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.012771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 439/884] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:15.013447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fb45-4cb4-4900-867d-d40e0fcf23d1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.013733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fb45-4cb4-4900-867d-d40e0fcf23d1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.014099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28fb45-4cb4-4900-867d-d40e0fcf23d1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.019514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 440/885] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:15.019644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a558a7-188e-4747-a986-e683937b7ca0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.023534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.023534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.023534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.029018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.045868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:15.047670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:15.053923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.054733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.055002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.055268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.062672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.064115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:15.079449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:15.080439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:15.081750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 446/886] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:40:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:15.082364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.125893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 441/887] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:15.127085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.207960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049b66e-09f7-4667-a2f6-6bc5c71bdd51 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.235084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77d1d3-2338-4bfc-956e-ecde039ec042 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.235935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.245180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.246197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.246481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.246754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.247890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] RBAC: Adding query filter params (interface=public, service_id=88fa98d4084e4bdba9a6deb873e3d79c, region_id=RegionOne) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:15.248203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.249762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.259617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 447/888] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/endpoints?service_id=88fa98d4084e4bdba9a6deb873e3d79c&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:15.259617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.270387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.276154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.276856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.277144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.277418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.278262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:15.278607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.280637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.298379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 442/889] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:15.299580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.377657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59b15e-fcc7-47fd-8a8d-66fe3d2c7c8e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.401690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f372e9b-fb45-4d55-ad9e-d9bbcab95d2c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.411494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.412300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.412585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.412886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.413542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.414903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:15.427239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:15.428415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:15.429258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 448/890] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:15.433612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.436611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.437399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.437677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.437944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.438624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.440001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eadbe-b775-444a-b7db-8dd08f33c3eb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.446879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 443/891] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/services => generated 1011 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:40:15.447548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0aae-c78a-457a-a51d-cd58a2ce3e78 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.447869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0aae-c78a-457a-a51d-cd58a2ce3e78 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.448090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0aae-c78a-457a-a51d-cd58a2ce3e78 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.449541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 444/892] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:15.450168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0aae-c78a-457a-a51d-cd58a2ce3e78 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.509306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.515184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.558627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7769d-1ec1-4922-b8c8-bd49571de133 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.567406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0aae-c78a-457a-a51d-cd58a2ce3e78 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.596341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.597106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.597444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.597722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.605595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.606290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.607372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.607372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.607602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:15.607863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.609345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07376-11d9-4128-9b3a-c61c47912f43 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.614469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 445/893] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:15.615498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.615825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.616096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.633055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:15.634289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:15.675260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.676737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.712803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 446/894] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:15.714029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.743124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.768162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:15.802303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 449/895] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:15.803286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.821208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c5e6b-a17a-41d5-b30b-ef5f57d3faa1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.857967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.858734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.859091 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.859440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.860227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:15.860607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.862104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:15.866978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 447/896] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:15.867671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:15.924958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e8d4-3f73-46e8-beb5-acd12e21e0d4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:15.975064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:15.975841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:15.976190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:15.976531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:15.977522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:15.978980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.000332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 450/897] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:15 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:16.020081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97faba43-3e95-43d5-a57f-26f1f86036e5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:16.033459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:16.068194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:16.069199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:16.069581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:16.069942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:16.082212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:16.083883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:16.104148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:16.105410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:16.106463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:16.106463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:16.106463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:16.106463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:16.108186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 448/898] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:16.113945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:16.135676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:16.229446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ff73-56b3-4bae-ba9d-ad222ebeb596 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:16.265226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:16.265899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:16.266177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:16.266453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:16.267181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:16.267488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:16.268889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.281575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:16.286846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:16.393184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a83275-6f26-4e81-af4d-77d674ae8f36 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:16.429461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced047-104d-4353-9660-d18978898358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:16.430410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced047-104d-4353-9660-d18978898358 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:16.430781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced047-104d-4353-9660-d18978898358 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:16.431147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ced047-104d-4353-9660-d18978898358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:16.438602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ced047-104d-4353-9660-d18978898358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:16.440180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ced047-104d-4353-9660-d18978898358 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-37ced047-104d-4353-9660-d18978898358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:16.454714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:16.455771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:16.456898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:16.458599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 449/900] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:16.464524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:16.543624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:16.568242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac1118-1fe8-4de6-a029-de7dc33f936c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:16.606260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:16.607266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:16.607699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:16.608134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:16.609129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:16.609601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:16.611186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85abe2e-c0cd-42f9-8e1c-2e9cb85970f6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.624272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 452/901] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:16.630172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced047-104d-4353-9660-d18978898358 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:16.657139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:16.733443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ced047-104d-4353-9660-d18978898358 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:16.767260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:16.768042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:16.768415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:16.768827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:16.769747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] RBAC: Adding query filter params (role.id=da3380f070f04497bad963d95c207681, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=d833fa0454b14478b733e0e21e559b2b) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:16.770150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:16.771693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940f798-2fad-4143-aa59-e5b4b3e17ef1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:16.777554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 450/902] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:16 2022] GET /identity/v3/role_assignments?user.id=d833fa0454b14478b733e0e21e559b2b&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=da3380f070f04497bad963d95c207681 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:17.489363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc2f6-cbc4-469a-abed-dea1a3e1d033 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:17.489912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc2f6-cbc4-469a-abed-dea1a3e1d033 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:17.489912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6bc2f6-cbc4-469a-abed-dea1a3e1d033 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:17.491467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 453/903] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:17.497442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:17.498562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:17.499154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:17.517163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:17.518642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:17.588813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 451/904] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:17.607807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc2f6-cbc4-469a-abed-dea1a3e1d033 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:17.710745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6bc2f6-cbc4-469a-abed-dea1a3e1d033 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:17.744875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:17.746036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:17.746510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:17.746970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:17.748056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:17.750164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:17.753316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:17.764776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:17.765759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 20 14:40:17.766561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:17.770004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 454/905] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:17.772340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:17.787972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:17.875080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b9c7b-259f-43bf-83b4-d5e92fd0e4a8 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:17.911785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:17.912454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:17.912755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:17.913040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:17.913909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:17.914223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:17.915784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b1f99-9430-4bd6-8d72-48f23f26785b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:17.921381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 452/906] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:17.926794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.031925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8b1b-2856-4c73-93d7-4beb94b6a021 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.037113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317fd0d-a684-47ac-b997-b1537a0afe73 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.037405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317fd0d-a684-47ac-b997-b1537a0afe73 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.037680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8317fd0d-a684-47ac-b997-b1537a0afe73 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.039393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 453/907] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:18.044302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4d234-f266-4646-a15a-d14f0d989d5f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.044589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4d234-f266-4646-a15a-d14f0d989d5f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.044914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4d234-f266-4646-a15a-d14f0d989d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.062299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-77b4d234-f266-4646-a15a-d14f0d989d5f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:18.063717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-77b4d234-f266-4646-a15a-d14f0d989d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:18.068229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.069157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.069611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.070087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.071009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:18.071503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.073179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.079128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 455/908] 10.222.0.23 () {56 vars in 1114 bytes} [Mon Jun 20 14:40:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:18.084768 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.152888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 454/909] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:18.161148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:18.176709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685ac6c-03cf-4dfe-b1b7-b2059b00b406 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.177052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685ac6c-03cf-4dfe-b1b7-b2059b00b406 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.177303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685ac6c-03cf-4dfe-b1b7-b2059b00b406 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.178780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 455/910] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:40:18.179493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685ac6c-03cf-4dfe-b1b7-b2059b00b406 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.190850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:18.209261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524ed04-cbb2-424d-922c-68b619a630d0 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.245343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.246126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.246505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.246781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.247609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.249005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c2bc2-5719-4b97-a8f4-91001bb54a5d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.276826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 456/911] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:18.276826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.276826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.276826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.295573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:18.297087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:18.303180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685ac6c-03cf-4dfe-b1b7-b2059b00b406 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.342097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.342932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.343310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.343785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.344834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.346407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.363696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 456/912] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:18 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:18.393686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 457/913] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:18.416639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.497337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:18.546205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf09c1-ccc6-4d5f-8885-b71e17ea614e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.583604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.584825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.585325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.585790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.586628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.588228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:18.601383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:18.602351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:18.603187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:18.603966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 457/914] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jun 20 14:40:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:18.610605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.657889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:18.715845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3066e9c-f254-41c5-9ae8-23ad69aff9ac None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.751002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.751678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.751956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.752230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.752977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:18.753286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.754671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15a89a-a17f-43c9-85c2-475e05d85259 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.760038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 458/915] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:18.765789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.851573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198a9d-c746-4602-a632-f0514a535646 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.851891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198a9d-c746-4602-a632-f0514a535646 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.852052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac198a9d-c746-4602-a632-f0514a535646 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.853759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 459/916] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:40:18.862667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.863463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.863844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.880231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fef0ed-8780-42f2-b354-70fa7d602743 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:18.885710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:18.887025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:18.911653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:18.922069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:18.922886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:18.923170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:18.923443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:18.924162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:18.924469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:18.926038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:18.933294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 458/917] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:18.939949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:18.974415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 460/918] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:19.002787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.046386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:19.057427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dae95-d636-42dc-80c5-29f6aadea146 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.095765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.096847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.097384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.097906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.099099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] RBAC: Adding query filter params (interface=public, service_id=47785dee453947c8be17b5ebdc2763c0, region_id=RegionOne) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:19.099626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.101469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.104146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e99554-190b-4be6-97ee-88b585e4e8c5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.108402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 459/919] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:18 2022] GET /identity/v3/endpoints?service_id=47785dee453947c8be17b5ebdc2763c0&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:19.121992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.139397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.140220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.140497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.140807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.151931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:19.160576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:19.161734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:19.162736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 461/920] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:19.168783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.184297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:19.244843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096115d-6ae3-4ce0-8bcc-10f3807e2c96 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.279443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:19.283364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fac4f6-b16c-4ee3-a985-dc92d5d97da6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.288220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.288920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.289205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.289476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.290160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.291557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.303930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 460/921] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:40:19.328382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.329579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.330130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.330614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.331634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:19.332147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.333811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.348749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 462/922] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:19.350599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.464943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb28be-3293-480e-91b6-82f333011ce5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.486949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:19.504737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.505948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.506430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.506913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.519086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.520898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:19.538916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:19.539923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:19.540836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:19.540836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:19.540836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:19.540836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:19.547502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 461/923] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:19.549611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.655481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b2513-3d95-41c5-affc-34353736dc1d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.690439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.691783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.692280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.692808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.693726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:19.694227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.695880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.712841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 463/924] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:19.715537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.818505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775362c7-1dfb-4ab2-bfdd-3f6e5bf52a7c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:19.852746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:19.853953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:19.854435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:19.854927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:19.863904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:19.865724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:19.880671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:19.881627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:19.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:19.888995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 462/925] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:19.891437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:19.921079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:19.999105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4750df-c842-4502-a5c7-9979853a627c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.047552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.048632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.049141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.049895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.050941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:20.051465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.053320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.077332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 464/926] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:40:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:20.082679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.114921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.186086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5838e-fc0b-4eed-a914-f731710c82d7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.220822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.221630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.221909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.222177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.233430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.234974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:20.252051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:20.252935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:20.253816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:20.253816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:20.253816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:20.253816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.257882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 463/927] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:20.259266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.343426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.363441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58916f9d-ce8b-4edf-a1bc-d3ed1621076f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.398511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.399178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.399457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.399724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.400451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:20.400775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.402141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3031ef-14ad-40c0-bccd-c3cd4a20baab None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.415407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 465/928] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:20.421287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.456471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ad4aa-36be-4a52-a6ca-bd96d2cbbd7d None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.456829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ad4aa-36be-4a52-a6ca-bd96d2cbbd7d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.457073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ad4aa-36be-4a52-a6ca-bd96d2cbbd7d None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.458665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 466/929] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:20.463536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4de1f-0915-4886-8deb-78e331af3d0f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.463815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4de1f-0915-4886-8deb-78e331af3d0f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.464087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4de1f-0915-4886-8deb-78e331af3d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.481289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5ae4de1f-0915-4886-8deb-78e331af3d0f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:20.482795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5ae4de1f-0915-4886-8deb-78e331af3d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:20.521196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.529548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff0ecf-4188-4c6c-9641-2ee2d4b45eba None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.552521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 467/930] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:20.558904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecba8e-74e6-477a-9646-fcdaa4b9d5e7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.559541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecba8e-74e6-477a-9646-fcdaa4b9d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.559945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ecba8e-74e6-477a-9646-fcdaa4b9d5e7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.565868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 468/931] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:20.568358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.568644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.568942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.577934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.578737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.579015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.579285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.586318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.587783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.588257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:20.589483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:20.602359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:20.603236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:20.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.606138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 464/932] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:20.607140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.661488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.677191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 469/933] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:20.678304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.721483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101a808-536b-4d63-b95f-efa91b44fb59 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.757149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.757779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.758051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.758339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.759023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.760476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.761873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING keystone.server.flask.common [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 14:40:20.776644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.780509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.sql.core [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 14:40:20.780509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 14:40:20.780509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [parameters: {'id': 'a7772f035b4e4b2b9e34452e964962f5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 14:40:20.780509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86687) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 14:40:20.783426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba825c5-6f6c-4865-b5fc-c7a92392e8c4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7772f035b4e4b2b9e34452e964962f5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7772f035b4e4b2b9e34452e964962f5. Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:40:20.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result.read() Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 20 14:40:20.789823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application yield resource Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise self.value Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application session.commit() Jun 20 14:40:20.790765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.session.flush() Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application compat.raise_( Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 14:40:20.792307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 14:40:20.794040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application result.read() Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:40:20.796545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [parameters: {'id': 'a7772f035b4e4b2b9e34452e964962f5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.799017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:20.802182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7772f035b4e4b2b9e34452e964962f5. Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 465/934] 10.222.0.23 () {60 vars in 1140 bytes} [Mon Jun 20 14:40:20 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:20.804975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.826308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.827002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.827253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.827522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.828378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:20.828620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.830101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.842560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 470/935] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:20.848172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:20.903043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0edd7-dccd-437f-91b2-7920fbacdc33 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.915848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:20.939940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:20.940787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:20.941071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:20.941349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:20.942428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:20.944041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:20.959546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:20.960573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:20.961417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:20.962136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faa544-5edd-451c-b336-3b02d126aee1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:20.962218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 466/936] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:20.962218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.000491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.001318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.001597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.001865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.008909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.010383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:21.024956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:21.025870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:21.027289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 471/937] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:21.027773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.038924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.081348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824a599-6605-47d9-8782-50800e79aa1a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.117790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.118626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.118903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.119173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/d833fa0454b14478b733e0e21e559b2b/roles/da3380f070f04497bad963d95c207681` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.121738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=d833fa0454b14478b733e0e21e559b2b, role_id=da3380f070f04497bad963d95c207681)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.123236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.137206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dfe8e4-0736-4cab-86b5-ff048ec1d799 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.137867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 467/938] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:20 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/d833fa0454b14478b733e0e21e559b2b/roles/da3380f070f04497bad963d95c207681 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:21.149727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.162513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.184170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.185063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.185415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.185782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.187147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:21.187562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.189442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.200973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 472/939] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:21.204559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.307567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6d88c-e53b-4bbb-a3cd-ac8450ffae14 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.331273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251d60e-7cd9-418d-8364-0b4ce85511aa None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.339367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.356821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.357534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.357799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.358083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.359328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:21.359644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.361618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21674-2d51-4a73-b853-f79f9a6533f2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.372583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.373668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.373953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.374230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.374948 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:21.375256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.376626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1f746-4236-43db-8c56-e4876b8f1536 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.381629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 473/940] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:21.382881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fdbf-deaa-46ff-a637-8cd7f19c29d5 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.383176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fdbf-deaa-46ff-a637-8cd7f19c29d5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.383452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540fdbf-deaa-46ff-a637-8cd7f19c29d5 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.384934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 474/941] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:21.390022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 468/942] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:21.393839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fdbf-deaa-46ff-a637-8cd7f19c29d5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.394679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.395145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.395585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.418527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:21.421418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:21.454138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.532742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540fdbf-deaa-46ff-a637-8cd7f19c29d5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.532987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 469/943] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:21.552486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.587640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.587640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.587897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.588123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.589484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] RBAC: Adding query filter params (interface=public, service_id=3a66aa2eb68940d9b776d584f204cfc9, region_id=RegionOne) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:21.589484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.590704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.596591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 475/944] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/endpoints?service_id=3a66aa2eb68940d9b776d584f204cfc9&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:21.602135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.678669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a9ec-d1f3-47ef-b8be-301f41f2b85a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.694632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.718485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.719443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.719713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.719985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.720645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.722204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:21.736078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:21.737097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:21.737940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 470/945] 10.222.0.23 () {56 vars in 1132 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:21.743427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:21.749781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6f086-21d7-481d-80d5-835a2e2798c8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.766802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:21.789318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.789985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.790263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.790534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.791280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.792697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.800033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 476/946] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:40:21.869960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24dc9a-c612-446b-8ef2-9779a3b68a60 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:21.909260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:21.909993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:21.910275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:21.910597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:21.911317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:21.911626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:21.913055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:21.919417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 471/947] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:21.925434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:22.046242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad8c50-ab50-489f-9d7c-a6bb2794b471 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:22.083212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:22.083886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:22.084168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:22.084448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:22.085197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:22.085564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:22.087010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d9fe9-453e-4f2f-b0b2-1de6c4596fc0 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:22.093096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 477/948] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:22.098365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:22.143738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:22.202961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9706a-f574-4268-a0e5-b79391e9000d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:22.239997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:22.240663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:22.241162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:22.241395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:22.242157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:22.243544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f44b14-85d6-4d96-8ad8-0e3504f52e62 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:22.267314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 472/949] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:23.238514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37ec0-1905-4968-b046-e2583973d005 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.239479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37ec0-1905-4968-b046-e2583973d005 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.239978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d37ec0-1905-4968-b046-e2583973d005 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.241857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 478/950] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:23.247361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.248218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.248886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.267552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:23.269112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:23.347920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 473/951] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:23.371710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d37ec0-1905-4968-b046-e2583973d005 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:23.419127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:23.483793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d37ec0-1905-4968-b046-e2583973d005 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:23.520017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:23.520868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.521154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.521431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.532877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e2ee9352-1d3d-42c8-a64a-81e5a568e55e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:23.541066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:23.541971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.542784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 479/952] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:23.549610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:23.579944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:23.603163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafa106-9c78-4a55-8f53-a346fadf9c28 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.603761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafa106-9c78-4a55-8f53-a346fadf9c28 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.604238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafa106-9c78-4a55-8f53-a346fadf9c28 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.606224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 480/953] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:23.611544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.612085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.612563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.632830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:23.634948 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:23.659933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de66ea5-808b-440c-9929-d4a139b109e4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:23.699015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:23.700062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.701086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.701575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.702611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:23.703118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:23.704727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:23.719380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 474/954] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:23.720589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:23.722576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 481/955] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:23.748606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:23.779678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:23.830369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:23.850763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93dedca-ec7d-407a-bc50-b5e1b2531684 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:23.859054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b4832-39e0-4c9a-8c2b-be70ec10abcc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:23.892665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:23.893924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.894415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.894912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.898851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:23.899594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.899880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.900155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.900895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:23.902403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:23.903948 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING keystone.server.flask.common [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 20 14:40:23.908683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:23.910201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:23.918738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.sql.core [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 14:40:23.918738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 14:40:23.918738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [parameters: {'user_id': 'a8d5a3e9a4774c8b87eafab1dfd3ba3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 14:40:23.918738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86686) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:23.929761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:23.930839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:23.931794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:23.931794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:23.931794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:23.931794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:23.931794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 475/956] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:23.937966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-1b2a36a6-45a9-4c16-9e63-f6f5ec89be9c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application result.read() Jun 20 14:40:23.939827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:40:23.940684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application yield resource Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application next(self.gen) Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self.session.rollback() Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self.force_reraise() Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise self.value Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application session.commit() Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 20 14:40:23.942062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._prepare_impl() Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self.session.flush() Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._flush(objects) Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application compat.raise_( Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application flush_context.execute() Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rec.execute(self) Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 20 14:40:23.943046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 20 14:40:23.943914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application result = self._query(query) Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application conn.query(q) Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application result.read() Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 20 14:40:23.945629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a8d5a3e9a4774c8b87eafab1dfd3ba3f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:23.947607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 20 14:40:23.949066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 482/957] 10.222.0.23 () {60 vars in 1131 bytes} [Mon Jun 20 14:40:23 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57051d-55ad-428f-8ca6-b046dd0ffc02 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57051d-55ad-428f-8ca6-b046dd0ffc02 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:23.951053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57051d-55ad-428f-8ca6-b046dd0ffc02 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:23.954836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 483/958] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:23.955407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57051d-55ad-428f-8ca6-b046dd0ffc02 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.057578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67628596-ac01-4d3b-b82a-2eac305405a5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.064373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.076494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57051d-55ad-428f-8ca6-b046dd0ffc02 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.094805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.095475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.095761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.096038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.096787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:24.097371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.098555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b2129-918b-4e31-9bb5-eee16ae0918b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.106370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.112460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.113268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.113546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.113824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.116652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 476/959] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:24.118053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.118343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.118620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.122583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.124194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.135417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:24.136647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:24.138692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:24.139635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:24.140566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 484/960] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:24.141209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.216767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 477/961] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:24.216767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.261798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487292af-978f-41a3-9d40-4cb5777f96dc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.297998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.298827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.299113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.299388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.307165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.308621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.321688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983a33f-6ace-40f5-bca2-4b36ab8f13d2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:24.324579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:24.325848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 485/962] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:24.326950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.342587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.348921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.357367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.358054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.358337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.358614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.359432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:24.359748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.361243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f85ba8-8f58-4ebd-b541-a7b53c2cedea None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.395665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 478/963] 10.222.0.23 () {56 vars in 1101 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:24.396926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cfb7-7519-44ea-a35c-f71ceebf08c2 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.397227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cfb7-7519-44ea-a35c-f71ceebf08c2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.397500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5cfb7-7519-44ea-a35c-f71ceebf08c2 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.398760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 479/964] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:24.399488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cfb7-7519-44ea-a35c-f71ceebf08c2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.445726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1300b-fa84-4ad2-b4e6-5f40536b1009 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.485569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.486398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.486728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.487009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.487789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.489407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-0d2d4b56-e611-423b-b502-d7cb7d474f7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:24.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:24.504345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:24.505591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 486/965] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:24.506635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.506635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.506635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.525607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:24.527191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:24.529603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5cfb7-7519-44ea-a35c-f71ceebf08c2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.573247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.574177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.574455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.574729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.575628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:24.575931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.577552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.597892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 480/966] 10.222.0.23 () {56 vars in 1149 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:24.598901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.612967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 487/967] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:24.614115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.623480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.659279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.714505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1042099-867d-4be1-aa22-2220c5e1eea8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.723074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ce41a-e19d-4e81-afbb-5f869f2cfe2e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.750274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.750930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.751209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.751481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.752185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:24.752469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.753933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.757494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.758149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.758432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.758706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.758982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 481/968] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:24.759829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.826908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.828367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.835844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.857493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba32ef4-3cef-4cd5-966c-c82002e137b3 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:24.866757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:24.893188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:24.893968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:24.894248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:24.894517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:24.895161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:24.896543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:24.908312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:24.909426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:24.910397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 482/969] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:24.911177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:24.933605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 488/970] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:24.934451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.019913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ccd69-6bbb-4506-8435-778685733d99 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.038057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c73dc8-e94c-4037-bf9b-476273ee67a7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.045921 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.057775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c63210-5723-4211-b74a-8701428de049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.058444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c63210-5723-4211-b74a-8701428de049 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.058723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c63210-5723-4211-b74a-8701428de049 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.058996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c63210-5723-4211-b74a-8701428de049 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.059751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c63210-5723-4211-b74a-8701428de049 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.060274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c63210-5723-4211-b74a-8701428de049 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.061816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c63210-5723-4211-b74a-8701428de049 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.067113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 483/971] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:25.067895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c63210-5723-4211-b74a-8701428de049 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.074488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.075242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.075650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.075952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.076703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.077040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.078407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.083397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 489/972] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:25.084151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.101239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.164210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c63210-5723-4211-b74a-8701428de049 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.181903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe22b3-21e4-4bf5-8411-a35f6423f676 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.197229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.198016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.198292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.198644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.209085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.210546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.216573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.217254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.217533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.217804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.218527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.219868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:25.227313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:25.228245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 484/973] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:25.229303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.242426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 490/974] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:25.243059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.278593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.343386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.357441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04edaa-cbfa-4fe2-ab82-42dfbb1dafdb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.373538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e5e24-9a4b-4c5a-9514-ab20874d8308 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.397588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.398259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.398541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.399447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.399553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.399799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.401231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.407083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 485/975] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:25.413120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.413819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.414091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.414411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.415182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.415490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.417005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.431848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 491/976] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:25.438950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.551711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b224e30-a0f8-44c6-aa72-98c1779c061f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.591371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.592373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.592781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.593158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.600633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.602235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:25.617271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:25.618352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:25.619452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:25.624752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 486/977] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:25.626997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.714512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.734946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bd5f9-1f0d-42c5-8c94-f0f7b5feff88 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.770652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.771499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.771883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.772255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.773193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.773602 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.775133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098397d-13cb-4fbb-a178-ff9b39eaa91b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.791850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 492/978] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:25.793128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:25.808776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:25.905503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79c19b-f615-4cb0-9609-1cd7dc3c1003 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:25.940318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:25.941003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:25.941288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:25.941889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:25.942722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] RBAC: Adding query filter params (role.id=da3380f070f04497bad963d95c207681, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=d833fa0454b14478b733e0e21e559b2b) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:25.943031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:25.944481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16b678-8eca-4d13-9421-3e2c5805d995 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:25.950908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 487/979] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:25 2022] GET /identity/v3/role_assignments?user.id=d833fa0454b14478b733e0e21e559b2b&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=da3380f070f04497bad963d95c207681 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:27.351348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9753-6e79-4b66-8e31-b7d03036589e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.351851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9753-6e79-4b66-8e31-b7d03036589e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.351851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9753-6e79-4b66-8e31-b7d03036589e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.353489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 493/980] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:27.359393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf58ee-f4af-437d-8c7a-13354cafd6f3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.359843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf58ee-f4af-437d-8c7a-13354cafd6f3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.359922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf58ee-f4af-437d-8c7a-13354cafd6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.377431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-dcaf58ee-f4af-437d-8c7a-13354cafd6f3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:27.378643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-dcaf58ee-f4af-437d-8c7a-13354cafd6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:27.449445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 488/981] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:27.459890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8ba0-5139-40f1-a723-5ea840cfeedc None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.460150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8ba0-5139-40f1-a723-5ea840cfeedc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.460450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d8ba0-5139-40f1-a723-5ea840cfeedc None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.462004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 494/982] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:27.467072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.467348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.467648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.472990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d8ba0-5139-40f1-a723-5ea840cfeedc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:27.479094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:27.486469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:27.487668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:27.567494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 489/983] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:27.585388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d8ba0-5139-40f1-a723-5ea840cfeedc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:27.590609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:27.620426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:27.621190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.621475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.621751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.623072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:27.624450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:27.636515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:27.637546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:27.638442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:27.643538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 495/984] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:27.644103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:27.653614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:27.700029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267de29-881f-4a1f-ab76-cd65de03a9c4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:27.740221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:27.741054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.741332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.741602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.742315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:27.744114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:27.748124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:27.752974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85dc08-3131-432e-9e4f-126f4e4e61c8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:27.772941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 490/985] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:27 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:27.798287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:27.798976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.799286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.799520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.800237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:27.800586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:27.801950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f319045-1930-44af-9dd2-0604f76dd800 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:27.813101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 496/986] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:27.814561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:27.931177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd624-2e2c-45bc-a6ee-11fe2147f233 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:27.967440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:27.968109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.968387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.968657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.969395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:27.969698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:27.971083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:27.976467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 491/987] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:27.982289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8bdd-8fe8-4cc8-8782-a1c1241109b5 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.982446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:27.982682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8bdd-8fe8-4cc8-8782-a1c1241109b5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.982857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c8bdd-8fe8-4cc8-8782-a1c1241109b5 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:27.984369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 497/988] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:27.989530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:27.989817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:27.990094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.009009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:28.010678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:28.052244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:28.079822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:28.088752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 498/989] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:28.100266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe909fb-ab2e-423c-9912-6136f5e168e7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:28.110221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:28.140020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:28.140672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:28.140976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:28.141250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.142044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] RBAC: Adding query filter params (interface=admin, service_id=3a66aa2eb68940d9b776d584f204cfc9, region_id=RegionOne) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:28.142363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:28.143747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:28.154229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 492/990] 10.222.0.23 () {56 vars in 1249 bytes} [Mon Jun 20 14:40:27 2022] GET /identity/v3/endpoints?service_id=3a66aa2eb68940d9b776d584f204cfc9&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:28.155288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:28.220135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345f469-b5a5-4248-8ced-225bfbd9f44a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:28.260409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:28.261471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:28.261751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:28.262133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] PATH_INFO: `/v3/services/image` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.262834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:28.264331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:28.271140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96106ae4-1ede-4da1-98da-3f2342b599e1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:28.280505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:28.281496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:28.282327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 499/991] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jun 20 14:40:28 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:28.288836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:28.303898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:28.317694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:28.318472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:28.318812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:28.319149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.319893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:28.321470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:28.328753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 493/992] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:28 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:40:28.369632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:28.417719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efd516-01da-4de3-9244-44c9732e5a50 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:28.456578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:28.457294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:28.457535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:28.457837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.458553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] RBAC: Adding query filter params (name=image) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:28.458855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:28.460240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84543f3b-1e06-4331-8ac4-b5ccf62eb769 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:28.466164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 500/993] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:28.471987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:28.578975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6455-56f4-45ad-9871-e75772491ce0 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:28.614154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:28.615105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:28.615530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:28.615967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:28.616846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:28.617312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:28.618887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff01dc4-6474-417a-af85-6f6c7bf5e2b9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:28.624237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 494/994] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:29.810342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3102a9-9552-41a3-bf95-3d7fff0e8e8e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:29.810946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3102a9-9552-41a3-bf95-3d7fff0e8e8e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:29.810946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3102a9-9552-41a3-bf95-3d7fff0e8e8e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:29.812473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 501/995] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:29.817889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:29.818302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:29.818471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:29.835782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:29.837015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:29.887141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:29.911567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 495/996] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:29.934313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3102a9-9552-41a3-bf95-3d7fff0e8e8e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.052009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3102a9-9552-41a3-bf95-3d7fff0e8e8e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.076935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.089153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.089964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.090244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.090518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] PATH_INFO: `/v3/services/compute` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.091493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.092861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:30.104825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:30.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:30.107801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:30.111183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 502/997] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:30.112024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.213733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef2502-d8cd-4116-b6ee-af526a3b127e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.248328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.249050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.249336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.249612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.250327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:30.250635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.252053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85d6be-eee9-4913-9c74-a628bf1318dc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.257264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 496/998] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:30.262761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.341665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf87ff-7e1f-4678-91ed-9ea2cffc0caa None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.341992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf87ff-7e1f-4678-91ed-9ea2cffc0caa None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.342174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf87ff-7e1f-4678-91ed-9ea2cffc0caa None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.343712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 497/999] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:30.348952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.349241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.349526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.367622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:30.368881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:30.370972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a2355-6049-42ba-9233-b2579e624b9f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.408785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.410284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.410573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.410851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.411567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:30.411876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.413324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.417132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.425540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 503/1000] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:30.426917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.443669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 498/1001] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:30.467640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.484137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.537618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362196ad-a9d3-4e3b-bdc8-05afa2950ae3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.573487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.574149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.574429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.574704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.575537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] RBAC: Adding query filter params (interface=public, service_id=57c9bfff7859465fa8ec435ae9fc7c48, region_id=RegionOne) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:30.576015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.576993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964da42-87a2-4082-b0d9-194b8dde8285 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.577415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.582806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 504/1002] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/endpoints?service_id=57c9bfff7859465fa8ec435ae9fc7c48&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:30.588309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.616673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.617820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.618103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.618380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.619037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.620491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9644106d-32b2-4f09-a0d4-219ea1c4595a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:30.633040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:30.634253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:30.640992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 499/1003] 10.222.0.23 () {56 vars in 1126 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:30.642776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d692a67-03dd-4a53-9aaa-e1902b0aab38 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.642776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d692a67-03dd-4a53-9aaa-e1902b0aab38 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.642776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d692a67-03dd-4a53-9aaa-e1902b0aab38 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.642776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 500/1004] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:30.642776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d692a67-03dd-4a53-9aaa-e1902b0aab38 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.685099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.700079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb173a3-73d6-453a-826c-160a69b60396 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.720650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.738776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.739445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.739729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.740002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.740685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.742095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284c650-715e-44ad-b4c0-11696fe28ef6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.748551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 505/1005] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:40:30.748858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d692a67-03dd-4a53-9aaa-e1902b0aab38 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.749920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.750206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.750477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.768146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:30.769415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:30.798540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.799274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.799520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.799796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.800526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:30.800877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.802327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.812729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 501/1006] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:30.813923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.850715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 506/1007] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:30.873449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.930304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258fd4cb-a309-4b86-8264-d542281af485 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:30.933032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:30.967095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:30.968135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:30.968529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:30.968840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:30.969579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:30.969888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:30.971306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:30.983381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 502/1008] 10.222.0.23 () {56 vars in 1122 bytes} [Mon Jun 20 14:40:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:30.984440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:30.992902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3a5d-c167-47ae-9e10-e779ed4d3298 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:31.005619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:31.040156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:31.041124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:31.041406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:31.041813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:31.042813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:31.044424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1e640-a336-4a5c-b85e-90284abe7b5f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:31.061470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 507/1009] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:30 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:31.102171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a8844-0e68-4ea3-a462-6a05665994ec None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:31.147992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:31.148568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:31.148890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:31.149160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:31.149967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:31.151431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d05ac-9f10-4293-9478-e02eb937783b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:31.172752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 503/1010] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:32.755484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58c19-b786-44a5-b842-8222638b57f7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:32.756052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58c19-b786-44a5-b842-8222638b57f7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:32.756052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c58c19-b786-44a5-b842-8222638b57f7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:32.757634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 508/1011] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:32.762822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:32.763264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:32.763445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:32.781026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:32.782218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:32.801372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:32.860031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 504/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:32.882438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58c19-b786-44a5-b842-8222638b57f7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:32.989819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c58c19-b786-44a5-b842-8222638b57f7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.035162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.035976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.036254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.036530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] PATH_INFO: `/v3/services/compute` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.037229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.038599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-925fa954-9de2-4722-adfc-b2c2177e9d8c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:33.050672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:33.051775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:33.057670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 509/1013] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:33.060039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.107631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa33f2-afc5-4fcb-8ab8-6439c1991f87 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.108133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa33f2-afc5-4fcb-8ab8-6439c1991f87 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.108424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa33f2-afc5-4fcb-8ab8-6439c1991f87 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.110629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 510/1014] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:33.116408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.116871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.117297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.139933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:33.141600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:33.165856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea436b7-1a2d-4172-9832-4f5aecb2e5f5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.173900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.205779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.206447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.206724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.206995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.207698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:33.207999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.209431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ed168-3a46-40bb-9fce-141079ae2e18 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.214235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 505/1015] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:33.215350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40c22-2372-46f9-b6f2-75ab50de229b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.215674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40c22-2372-46f9-b6f2-75ab50de229b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.215952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b40c22-2372-46f9-b6f2-75ab50de229b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.216656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 511/1016] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:33 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:33.217336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 506/1017] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:33.220091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.225873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.226160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.226435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.242718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:33.243906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:33.253373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.313309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 507/1018] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:33 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:33.314066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.323413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9dca4-41a5-43ff-beae-67bb07dfc690 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.357973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.358644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.358924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.359197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.360037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:33.360368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.361754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.366843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 512/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:33.369980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.396451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.412478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589b42d-6787-45fe-a09f-6b26daab77f1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.445819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.446613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.446895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.447168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] PATH_INFO: `/v3/services/image` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.447817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.449241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:33.460935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:33.462151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:33.463555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 508/1020] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:33.465397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.469873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc2e-69b4-408d-8662-9cff473eaf72 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.476885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.504394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.505227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.505526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.505792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.506993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.508740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.510536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 513/1021] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:33.511136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.571691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecefbd6b-383b-4697-bda7-a5963e884629 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.614678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.615059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.615649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.615795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.615955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.616786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.618241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.622415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5d193-7121-4c88-8d49-b7f5bed04cf3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.638466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 509/1022] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:33.639274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.682109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.683096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.683377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.683611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.685195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:33.685525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.687003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.693012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 514/1023] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:33.699163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:33.731179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:33.783745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a65697-ede0-460a-acdc-92cd803631cc None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.821041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3f09-deb3-49e0-9051-0a413e1fd4c6 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:33.824021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.824620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.825036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.825515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.826248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.827716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.861378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:33.862441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:33.862913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:33.863191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:33.863910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] RBAC: Adding query filter params (type=image) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:33.864271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:33.865760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:33.867455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 510/1024] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:33 2022] POST /identity/v3/projects => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:33.872452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 515/1025] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:33.877982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:34.004593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef887e81-848f-4f5d-8434-b80866e4e52f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:34.029461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:34.049422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:34.050390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:34.050677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:34.050954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:34.051745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] RBAC: Adding query filter params (interface=public, service_id=664c5d9d8db445dba448c92759c7908b, region_id=RegionOne) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:34.052057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:34.053498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e6da-8ea6-4c0a-9796-b0a26106721c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:34.059567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 511/1026] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:40:33 2022] GET /identity/v3/endpoints?service_id=664c5d9d8db445dba448c92759c7908b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:34.065268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:34.089004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:34.171636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78456709-d67c-4949-8dcc-6a66ded33982 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:34.207956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:34.208976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:34.209462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:34.209920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:34.210777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:34.212316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec509be-ea64-4192-9547-4b07b99d3878 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:34.219954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 516/1027] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:40:34 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:40:35.777696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774bdb-1df8-4547-b6ad-8dce46c70f17 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:35.778469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774bdb-1df8-4547-b6ad-8dce46c70f17 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:35.778469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e774bdb-1df8-4547-b6ad-8dce46c70f17 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:35.779659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 512/1028] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:35.785212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8cec-81a1-4ba7-b438-d14ba566d046 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:35.785651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8cec-81a1-4ba7-b438-d14ba566d046 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:35.785729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c8cec-81a1-4ba7-b438-d14ba566d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:35.803268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1b3c8cec-81a1-4ba7-b438-d14ba566d046 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:35.804472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1b3c8cec-81a1-4ba7-b438-d14ba566d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:35.876445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 517/1029] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:35.899905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e774bdb-1df8-4547-b6ad-8dce46c70f17 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:35.904046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098b5a-74ea-4785-b630-f2785e0cd910 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:35.904421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098b5a-74ea-4785-b630-f2785e0cd910 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:35.904702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa098b5a-74ea-4785-b630-f2785e0cd910 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:35.906265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 518/1030] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:40:35.911451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:35.911751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:35.912019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:35.928608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:35.929876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:35.940282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.010169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 519/1031] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:36.026763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e774bdb-1df8-4547-b6ad-8dce46c70f17 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.034452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.062925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.063767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.064084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.064512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.076337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:36.084654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:36.085748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:36.086847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 513/1032] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:36.091889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.136459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.143150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966bda7-aa64-49f8-b996-6ece6be6ab85 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.180363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.181196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.181479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.181754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.182936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.184402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.186240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 520/1033] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:36.192012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.198320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4f44e-b987-485b-92ed-a9fadfbf1fdd None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.207623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.236422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.237126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.237396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.237671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.238416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:36.238721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.240121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285bb55-df4d-439e-9a80-81e00a8555b5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.248333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 514/1034] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:36.249641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f8e8-cbd2-495b-83fc-4e8b4074e7dc None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.249958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f8e8-cbd2-495b-83fc-4e8b4074e7dc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.250234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1f8e8-cbd2-495b-83fc-4e8b4074e7dc None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.251638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 515/1035] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:36.253826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f8e8-cbd2-495b-83fc-4e8b4074e7dc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.297982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b1278-616a-406c-8473-db1235f3b92d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.330827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.331498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.331778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.332052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.332814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.334258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b1481-bfa6-43f1-9eb4-d6e77b397a6e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.354412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 521/1036] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:40:36 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:36.355641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.355979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.356567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.357380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1f8e8-cbd2-495b-83fc-4e8b4074e7dc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.359393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.374780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:36.385267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:36.412371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.414537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.415287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.416073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.432373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.435551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.455666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:36.458453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:36.459347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:36.460222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:36.460222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:36.460222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:36.460222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:36.467419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 516/1037] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:36.469635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.470869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 522/1038] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:36.485831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.587784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845297e1-2481-4310-a9b9-b924dc5718e5 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.603476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95127d-f802-4334-8074-873d49efcbe6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.629057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.629635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.629916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.630188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.630906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:36.631210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.632610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.639810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.640611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.640926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.641195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] PATH_INFO: `/v3/services/image` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.641859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.643213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.648743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 517/1039] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:36.650561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:36.660953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:36.661940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:36.668365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 523/1040] 10.222.0.23 () {56 vars in 1105 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:36.670119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.670243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.752594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.763779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fec79-ba1a-438a-b963-080da1717864 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.797538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cedb9-99fa-4fc0-9d56-3d8917db42ab None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.798102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.798674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.798954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.799226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.807094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.808558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:36.823186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:36.824198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:36.825260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 518/1041] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:36.830213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.836531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.837249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.837537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.837868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.838529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] RBAC: Adding query filter params (name=image) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:36.838839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.840706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.847843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 524/1042] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:36.854378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:36.916675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.943966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2850558-4d1e-4bba-a575-5a7d9bb603ee None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.960168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae69e38-8c8d-4190-96a1-02f5532deb98 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:36.978771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.979449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.979738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.980015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:36.981353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:36.981353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:36.982747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:36.987751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:36.998261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:36.998957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:36.999288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:36.999600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.000352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] RBAC: Adding query filter params (type=image) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:37.000876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.000990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 519/1043] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:37.002095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.006539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.010724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 525/1044] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:37.016479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.131020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ae9db-102a-4039-a5d7-223e35d29a8f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:37.135764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7df923-2b14-454e-aac4-87536fc4702e None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:37.165942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:37.166663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:37.166979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:37.167291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.168057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.169522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.169930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:37.175581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:37.176766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:37.177625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:37.177909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.189078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 526/1045] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:40:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:40:37.258278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.259835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.368068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 520/1046] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:37 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 14:40:37.374080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.427713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:37.491760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b503b-9e55-4410-9665-514539d28581 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:37.528940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:37.529765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:37.530083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:37.530388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.541563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.543175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:37.560791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:37.561736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:37.562615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:37.562615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:37.562615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:37.562615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:37.562615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 527/1047] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:37.568093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.599072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:37.670332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4a449-bac5-4c0a-9cfa-c08e7a2a623b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:37.704590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:37.705257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:37.705543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:37.705810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.706538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:37.706835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.708211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.719958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 521/1048] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:37.725410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.819482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:37.828348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1b746-2469-42f1-bdee-34c1835adcef None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:37.861991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:37.862805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:37.863123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:37.863421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:37.870528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:37.872051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:37.886310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:37.887176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:37.888322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:37.892473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 528/1049] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:37.893771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:37.993441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:38.004036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b829e-7a0d-4099-ac69-6da6a8199c45 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:38.046603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:38.047272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.047556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.047829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.048609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:38.048943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:38.050397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ae456-b3aa-4e92-bfb6-1f09f627889b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:38.062898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 522/1050] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:38.069067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:38.171305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ace39-138b-43a9-855f-733778a0c8f9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:38.205823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:38.206499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.206815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.207120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.207971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] RBAC: Adding query filter params (role.id=da3380f070f04497bad963d95c207681, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:38.208294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:38.209771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca872c6-0380-492a-96e7-127e8243c14a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:38.220809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 529/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:38 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=da3380f070f04497bad963d95c207681 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:38.431064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad979-7c72-47ed-88fe-b0a65a842863 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.431389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad979-7c72-47ed-88fe-b0a65a842863 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.431628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfad979-7c72-47ed-88fe-b0a65a842863 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.433240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 523/1052] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:38.438627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.438952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.439267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.457381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:38.458576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:38.472884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:38.531264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 530/1053] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:38.554110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad979-7c72-47ed-88fe-b0a65a842863 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:38.660990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfad979-7c72-47ed-88fe-b0a65a842863 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:38.695754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:38.696472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.696765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.697050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.707380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:38.715048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:38.716013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:38.716923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:38.721123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 524/1054] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:38.722296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:38.823135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d2286-3a56-4941-93d3-330d1314558b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:38.857648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:38.858322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:38.858602 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:38.858871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:38.859616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:38.859923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:38.861399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:38.874641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 531/1055] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:38.876245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:38.892625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:38.982481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a96bb5-e483-4173-99af-38f2adbf5be7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.026601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.027510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.027790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.028061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] PATH_INFO: `/v3/users/bea94db825694c29a15613e1467d420e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.043482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=bea94db825694c29a15613e1467d420e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.045067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da02ff-0094-4e04-967e-cac067680ee0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.051421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 525/1056] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:38 2022] GET /identity/v3/users/bea94db825694c29a15613e1467d420e => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:39.053064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.067193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.158678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91854f3-02e4-44e1-8753-c9b77fa1ad34 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.193363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.194017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.194297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.194572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.224390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660036-a3ae-447d-be20-7c0235fbd1c5 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.224695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660036-a3ae-447d-be20-7c0235fbd1c5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.224971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76660036-a3ae-447d-be20-7c0235fbd1c5 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.226398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 526/1057] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:39.231357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.231660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.231975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.248492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:39.249647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:39.267085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.268805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.283262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.316890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.332734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 527/1058] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:39.345929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.383059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 532/1059] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:39.388841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.461120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa756f7-75a3-42b5-8f0a-89a9f5b6dbfe None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.494521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38419f7d-2161-488f-a302-12d3c80bed75 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.500399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.501072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.501319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.501610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.505917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.530986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.531689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.531969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.532236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.533429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.534870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.536823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 533/1060] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:39.542869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.579263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.582818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.584369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.651185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762eed4-11d2-4835-9aad-e5071cfd8105 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.686001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.686683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.686937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.687210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.688052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=883b0a19bfca4429b0649c1a65487f3f, user.id=bea94db825694c29a15613e1467d420e) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:39.688366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.689858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.695179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 528/1061] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:39.696769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 534/1062] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/role_assignments?user.id=bea94db825694c29a15613e1467d420e&scope.project.id=883b0a19bfca4429b0649c1a65487f3f&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:39.701940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.813957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:39.818694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd582d21-8d62-4e17-9a43-b30bc4cbb7f9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:39.862926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:39.863737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:39.864019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:39.864292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:39.874896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:39.876362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-5b738df9-7407-46d4-a9f3-c330e302d8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:39.894129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:39.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:39.895941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:39.895941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:39.895941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:39.895941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:39.896844 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 529/1063] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:39.901446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:39.948630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:40.013272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ed4f6-6f16-4978-9a0f-3ffc4cc287b5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:40.052750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:40.053446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.053713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.053989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.054709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:40.055016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:40.056384 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce210838-a912-4028-8dd6-95a041afcd54 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:40.069614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 535/1064] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:40.216319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d4c8-3e31-465e-8251-053c388c2cd1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.216880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d4c8-3e31-465e-8251-053c388c2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.216880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925d4c8-3e31-465e-8251-053c388c2cd1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.218248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 530/1065] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:40.224004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.224295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.224573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.242849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:40.244048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:40.320506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 536/1066] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:40.342779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925d4c8-3e31-465e-8251-053c388c2cd1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:40.448767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925d4c8-3e31-465e-8251-053c388c2cd1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:40.484272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:40.485106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.485384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.485654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.495688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:40.503905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:40.504901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:40.505754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 531/1067] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:40.511465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:40.542806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:40.617376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22cce-fc9c-46f4-83e0-cadd065bf9c0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:40.653350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:40.654151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.654433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.654710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.655461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:40.655769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:40.657179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:40.665755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 537/1068] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:40.671560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:40.687988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:40.776153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1ee48-37ee-4ddc-9f5e-375ab4d54de8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:40.813061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:40.813873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.814156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.814428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.825753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:40.827237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:40.844867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:40.845791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:40.846799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:40.846799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:40.846799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:40.846799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:40.846799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 532/1069] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:40.852054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:40.948353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:40.956832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa2f47-d003-46ba-abc9-535763318aa7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:40.991793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:40.992455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:40.992706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:40.993032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:40.993759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:40.994065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:40.995428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.008178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 538/1070] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:41.013175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.080944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:41.121051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb6d2b-02fd-4643-ad79-2a06c0c09e25 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.158678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.159477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.159760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.160035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.168041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:41.169980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:41.184377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:41.185405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:41.186330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 533/1071] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:41.192312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.297807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd39b5-4a5a-46d3-9b77-6247d2b2a0b8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.333896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.334558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.334841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.335121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.335959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:41.336268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:41.337719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.355303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 539/1072] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:41.361658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.468831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e52161d-5e01-4a41-97d8-6a0b20547238 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.493039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:41.505053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.505843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.506125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.506397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.517272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:41.518729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ca830cb6-a8b4-4652-bad5-c0df724803d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:41.535722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:41.536640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:41.537579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:41.537579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:41.537579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:41.537579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:41.537579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 534/1073] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:41.542687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.557888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:41.649007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247c6c3-5dd8-448e-9000-c5c9615d7ccd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.686103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.686791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.687068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.687342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.688071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:41.688376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:41.689789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.701920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 540/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:41.704439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255378-2e79-4c34-a763-495e088e72e3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.704864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255378-2e79-4c34-a763-495e088e72e3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.705152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34255378-2e79-4c34-a763-495e088e72e3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.706836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 535/1075] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:41.707581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.711951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.712239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.712514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.730056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:41.731325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:41.778529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:41.799493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 536/1076] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:41.809896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a55e8a2-341e-425e-8e01-3f284da1540a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.822308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.846300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.847105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.847391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.847666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.854413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:41.855853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:41.870001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:41.870891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:41.871778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 541/1077] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:41.877353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:41.924309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dd6e8-3f91-4ad5-b54f-3328e67a071b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.931997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:41.960288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:41.961159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:41.961434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:41.961697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:41.972106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:41.979782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:41.980771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:41.981864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 537/1078] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:41.982554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de958f70-1f32-470f-b51c-5507dc685f1a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:41.987087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:42.014532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:42.020909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.021583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.021859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.022121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.022910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:42.023223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.024690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.036628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 542/1079] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:42.042477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:42.093199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562968c3-c27e-46c7-b9f5-c8970b32afcb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:42.129284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.129938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.130215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.130481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.131224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:42.131516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.132951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.140273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b9f3b-ff0b-4df0-b2cc-195c4163b170 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:42.140941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 538/1080] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:42.146621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:42.175271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:42.175428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.176270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.176683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.176865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/da3380f070f04497bad963d95c207681` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.179743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=644364ac21704f9281845a8af6fa0b30, role_id=da3380f070f04497bad963d95c207681)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.181217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.196045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 543/1081] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:42 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/644364ac21704f9281845a8af6fa0b30/roles/da3380f070f04497bad963d95c207681 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:40:42.255632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303460ba-7be0-4e53-8563-e8977df06e31 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:42.290524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.291411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.291665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.291954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] PATH_INFO: `/v3/users/bea94db825694c29a15613e1467d420e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.293209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] RBAC: Authorizing `identity:get_user(user_id=bea94db825694c29a15613e1467d420e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.294821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.296483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 539/1082] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:42 2022] GET /identity/v3/users/bea94db825694c29a15613e1467d420e => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:42.302469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:42.359505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:42.409737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5b93-7cc4-4754-9ee5-524935135254 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:42.445538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.446409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.446688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.446962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.448178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.449636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a777db9-3c18-4dc5-99b0-7d2fd0616136 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.451536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 544/1083] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:42 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:42.457558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:42.556572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:42.563292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d10530-e526-44a6-889e-cbde740678b2 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:42.598251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:42.599157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:42.599468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:42.599743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f/users/bea94db825694c29a15613e1467d420e/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:42.601777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] RBAC: Authorizing `identity:create_grant(project_id=883b0a19bfca4429b0649c1a65487f3f, user_id=bea94db825694c29a15613e1467d420e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:42.603235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59679941-6b3d-4908-a9f9-f88ead7781ae None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:42.617110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 540/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:42 2022] PUT /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f/users/bea94db825694c29a15613e1467d420e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:44.193581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e206-d3d1-4550-9448-5bc086a3f2fd None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.194156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e206-d3d1-4550-9448-5bc086a3f2fd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.194156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3e206-d3d1-4550-9448-5bc086a3f2fd None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.195483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 545/1085] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:44.200899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.201326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.201472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.219357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:44.220549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:44.289466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 541/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:44.313231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e206-d3d1-4550-9448-5bc086a3f2fd None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.427535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3e206-d3d1-4550-9448-5bc086a3f2fd None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.448371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:44.464532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:44.465557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.466090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.466090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.477723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-c35bd02a-a4a7-4d9d-a5b1-e02baca1daa5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:44.485955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:44.487141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:44.493436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 546/1087] 10.222.0.23 () {56 vars in 1120 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:44.494316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.579053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:44.581951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc318c3-b10c-461e-8333-970762a48f47 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.582252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc318c3-b10c-461e-8333-970762a48f47 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.582551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc318c3-b10c-461e-8333-970762a48f47 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.584066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 547/1088] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:44.589111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.589471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.589828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.595821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdbad4-5233-4cc4-867a-568394bbed7d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.607186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:44.608379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:44.635659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185447-05a3-4663-81db-efe330810a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:44.636332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185447-05a3-4663-81db-efe330810a4f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.636612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185447-05a3-4663-81db-efe330810a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.636984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185447-05a3-4663-81db-efe330810a4f None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.637776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185447-05a3-4663-81db-efe330810a4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:44.638258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185447-05a3-4663-81db-efe330810a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:44.639647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44185447-05a3-4663-81db-efe330810a4f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:44.648450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 542/1089] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:44.654021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185447-05a3-4663-81db-efe330810a4f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.696896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 548/1090] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:44.712187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.768107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44185447-05a3-4663-81db-efe330810a4f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.803444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:44.804243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.804521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.804824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.815835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:44.817822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:44.817989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9b5ca-85c5-4a2d-ab93-e726b6107f9a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.826542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:44.830209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:44.836311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:44.837224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:44.838104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:44.838104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:44.838104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:44.838104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:44.838104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 543/1091] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:44.843710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.856791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:44.857965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.858408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.858845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.869619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:40:44.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:44.878387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:40:44.879429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 549/1092] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:44.884435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:44.952205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc90f-c3da-4409-9e0f-4b8907aecefb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.987624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0b8f8-a2fc-43d7-8715-185712df2811 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:44.989131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:44.989789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:44.990072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:44.990343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:44.991090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:44.991397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:44.992809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.004637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 544/1093] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.010779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.026464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.027151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.027432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.027708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.028688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:45.029034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.030409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.039091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 550/1094] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.044899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.070566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.076784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.111355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140307a-ba3d-4d27-9176-032124f3e503 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.144376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.145209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.145489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.145759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.147014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd3372-f647-4fa5-aa61-0df9deb6206b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.152842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.154298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:40:45.168775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:45.169832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:45.170814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 545/1095] 10.222.0.23 () {56 vars in 1093 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:45.175873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.181981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.182874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.183156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.183425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] PATH_INFO: `/v3/users/bea94db825694c29a15613e1467d420e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.184645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] RBAC: Authorizing `identity:get_user(user_id=bea94db825694c29a15613e1467d420e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.186096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.192136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 551/1096] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/users/bea94db825694c29a15613e1467d420e => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.193579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.281132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024538a-7b93-4533-be80-d1527feefa93 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.288708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.292002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfb2ca-e7ff-4bc8-97ab-ab67764b9d5d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.301495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.315817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.316838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.317118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.317383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.318210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:45.318518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.319964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.328277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.328959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.329244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.329526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.337818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 546/1097] 10.222.0.23 () {56 vars in 1133 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.343636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.397772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.399159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.446465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da30317-6a28-486e-9f0a-85c83cdf6b08 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.483514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.484167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.484448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.484739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.494752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.499427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 552/1098] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 14:40:45.504934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.532698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.555020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.556496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.602897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c27439-cf95-4371-ba2d-127beffd2ccf None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.636103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.636983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.637254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.637503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.638757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.640187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.641978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 553/1099] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.647961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.656911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 547/1100] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:45.662568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.715532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.742071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.748190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0160957-33ba-43f3-bf7d-85776def01cd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.763770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f13f0-8f89-47a8-9928-2d1e10d4c953 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.783283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.783939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.784224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.784592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.785511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=883b0a19bfca4429b0649c1a65487f3f, user.id=bea94db825694c29a15613e1467d420e) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:45.785863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.787376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.794160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 554/1101] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/role_assignments?user.id=bea94db825694c29a15613e1467d420e&scope.project.id=883b0a19bfca4429b0649c1a65487f3f&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:45.799279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.800084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.800363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.800634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.812451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.814022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:40:45.834232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:45.835342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:45.842167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:40:45.842167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:40:45.842167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:40:45.842167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:45.842167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 548/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:40:45.842532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:45.956267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1592ec-1d4d-486d-a5b1-803a26b9e21b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:45.988567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:45.994332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:45.995000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:45.995286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:45.995597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:45.996327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:45.996635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:45.998616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:46.010610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 555/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:46.017155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:46.128295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62bbc9-0da2-4445-b931-69e25327fe53 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:46.159328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:46.166201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:46.167004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:46.167295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:46.167568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:46.174847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:46.176314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:40:46.190082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:40:46.190991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:40:46.192212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 549/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:40:46.197574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:46.304119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4818d4-2e1f-4067-85e9-5b84c79b46c8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:46.339476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:46.340140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:46.340594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:46.340939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:46.341695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:46.342005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:46.343461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0263798-576b-4f71-99a0-b65117e287b1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:46.356200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 556/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:46.362523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:46.472076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac77e48-2e6e-4505-9b55-b00d97850709 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:46.508146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:46.508834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:46.509113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:46.509387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:46.510225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] RBAC: Adding query filter params (role.id=da3380f070f04497bad963d95c207681, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=644364ac21704f9281845a8af6fa0b30) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:46.510535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:46.511993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3e1b3-e16b-475c-9199-4f5d0aa9fd00 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:46.518408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 550/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:46 2022] GET /identity/v3/role_assignments?user.id=644364ac21704f9281845a8af6fa0b30&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=da3380f070f04497bad963d95c207681 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:47.827844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92df6-e80e-4d80-91d3-ae4894ff7fcb None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:47.828763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92df6-e80e-4d80-91d3-ae4894ff7fcb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:47.828763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e92df6-e80e-4d80-91d3-ae4894ff7fcb None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:47.830914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 557/1107] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:47.838813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:47.839258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:47.839356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:47.857744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:47.858925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:47.909910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:47.937732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 551/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:40:47.962814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92df6-e80e-4d80-91d3-ae4894ff7fcb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:48.024469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:48.085996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e92df6-e80e-4d80-91d3-ae4894ff7fcb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:48.126356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:48.127137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:48.127411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:48.127675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:48.129000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:48.130425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c36e25-a832-475f-9ccf-30e3fc383116 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:48.132059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 558/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:48.140071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:48.244439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41a93-7e0b-45a2-b00a-f4311173ef5c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:48.285215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:48.285875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:48.286154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:48.286424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:48.287131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:48.288591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cf8b8-bfc0-4889-a425-bfbb4a7f555b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:48.311923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 552/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:40:48 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:40:50.343655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd5ec-3a79-4e97-bb3d-b01eb266dbfb None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:50.344182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd5ec-3a79-4e97-bb3d-b01eb266dbfb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:50.344182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd5ec-3a79-4e97-bb3d-b01eb266dbfb None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:50.345503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 559/1111] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:50.351828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:50.352492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:50.352702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:50.372221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:50.373475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:50.409583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:50.444622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 553/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:50.468859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd5ec-3a79-4e97-bb3d-b01eb266dbfb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:50.587418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd5ec-3a79-4e97-bb3d-b01eb266dbfb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:50.607682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:50.624436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:50.625321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:50.625598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:50.625871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] PATH_INFO: `/v3/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:50.627457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] RBAC: Authorizing `identity:get_role(role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:50.628878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:50.630293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 560/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:50 2022] GET /identity/v3/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:50.636584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:50.753758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a19979-981f-4c8d-a618-9525f9f6e1d2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:50.792115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:50.793114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:50.793445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:50.793895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] PATH_INFO: `/v3/users/8e246d486b864ba086a66c2aef01fe2b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:50.809351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] RBAC: Authorizing `identity:get_user(user_id=8e246d486b864ba086a66c2aef01fe2b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:50.810816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:50.812490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 554/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:50 2022] GET /identity/v3/users/8e246d486b864ba086a66c2aef01fe2b => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:50.818789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:50.933434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e524ff-6640-43a9-9929-148ee2b5ef7b None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:50.971576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:50.972215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:50.972504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:50.972801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:51.036595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:51.051111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:51.052581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:51.164636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 561/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:51.171561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:51.213648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:51.291094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51194-ce82-42ee-a12b-12ac4650af80 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:51.329979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:51.330832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:51.331111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:51.331378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:51.332688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:51.334186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5deb5f4-0bae-4e63-98e3-35f0fb57a248 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:51.335889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 555/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:51 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:51.343187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:51.439574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:51.452632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e723-5268-4b0a-a703-4518e184f374 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:51.487386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:51.487961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:51.488240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:51.488508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:51.489362 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=883b0a19bfca4429b0649c1a65487f3f, user.id=8e246d486b864ba086a66c2aef01fe2b) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:51.489669 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:51.491097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4fe3-6172-4f8e-b405-eccb89fb495e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:51.496757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 562/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:51 2022] GET /identity/v3/role_assignments?user.id=8e246d486b864ba086a66c2aef01fe2b&scope.project.id=883b0a19bfca4429b0649c1a65487f3f&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:53.467692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f503-678f-4556-81e8-001be40f0bc0 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:53.468560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f503-678f-4556-81e8-001be40f0bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:53.468560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5f503-678f-4556-81e8-001be40f0bc0 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:53.470785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 556/1118] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:53.476118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:53.476555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:53.476647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:53.495110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:53.496283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:53.566936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 563/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:53.590257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5f503-678f-4556-81e8-001be40f0bc0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:53.690567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:53.703239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5f503-678f-4556-81e8-001be40f0bc0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:53.744530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:53.745368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:53.745647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:53.745939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] PATH_INFO: `/v3/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:53.747657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] RBAC: Authorizing `identity:get_role(role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:53.749073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:53.750455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 557/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:53 2022] GET /identity/v3/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:53.759296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:53.847975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:53.875896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65cf2a3-d12a-4234-aaaf-922b57b0e21b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:53.917014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:53.917883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:53.918306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:53.918531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] PATH_INFO: `/v3/users/8e246d486b864ba086a66c2aef01fe2b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:53.920043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=8e246d486b864ba086a66c2aef01fe2b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:53.921501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:53.923167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 564/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:53 2022] GET /identity/v3/users/8e246d486b864ba086a66c2aef01fe2b => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:53.929188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:54.034770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd943-df60-4b3c-84de-80bb00e327a4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:54.074595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:54.075312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:54.075589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:54.075859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:54.077198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:54.078631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c5cde-2ecb-437c-baba-920a3a0b8a4c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:54.080361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 558/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:53 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:54.086609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:54.188225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720c1de-9797-4e67-8055-587333561ac5 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:54.224243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:54.225170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:54.225446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:54.225711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f/users/8e246d486b864ba086a66c2aef01fe2b/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:54.228580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] RBAC: Authorizing `identity:create_grant(project_id=883b0a19bfca4429b0649c1a65487f3f, user_id=8e246d486b864ba086a66c2aef01fe2b, role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:54.230046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c10d71-302f-41f8-bd54-adaecc6c4adc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:54.247634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 565/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:40:54 2022] PUT /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f/users/8e246d486b864ba086a66c2aef01fe2b/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:40:56.297836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6a2c-5c61-4a2b-8fd4-182d4c3eef34 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:56.298660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6a2c-5c61-4a2b-8fd4-182d4c3eef34 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:56.298660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d6a2c-5c61-4a2b-8fd4-182d4c3eef34 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:56.300885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 559/1124] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:56.306277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:56.306693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:56.306801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:56.325551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:56.326741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:56.329525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:56.404695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 566/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:56.428694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d6a2c-5c61-4a2b-8fd4-182d4c3eef34 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:56.462571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:56.544472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d6a2c-5c61-4a2b-8fd4-182d4c3eef34 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:56.583279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:56.584080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:56.584364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:56.584637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] PATH_INFO: `/v3/roles/69aab65303b34d8fa3995ff8bc58c38b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:56.586265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] RBAC: Authorizing `identity:get_role(role_id=69aab65303b34d8fa3995ff8bc58c38b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:56.587674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:56.589102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 560/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:56 2022] GET /identity/v3/roles/69aab65303b34d8fa3995ff8bc58c38b => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:56.597760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:56.699366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a64dd-b7ce-4cf1-8a34-f7641db36676 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:56.740306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:56.741219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:56.741505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:56.741780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] PATH_INFO: `/v3/users/8e246d486b864ba086a66c2aef01fe2b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:56.743079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] RBAC: Authorizing `identity:get_user(user_id=8e246d486b864ba086a66c2aef01fe2b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:56.744549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:56.746241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 567/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:40:56 2022] GET /identity/v3/users/8e246d486b864ba086a66c2aef01fe2b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:40:56.754856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:56.861618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:56.865048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef13f26-d82c-4b61-991f-c7453c2ddaac None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:56.900403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:56.901073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:56.901381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:56.901659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:56.970427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:56.971893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:57.072393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:57.077857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 561/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:40:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:40:57.084514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:57.102160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:57.194678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cea884-90c4-417c-bcb5-894a5415fe46 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:57.229642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:57.230488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:57.230846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:57.231113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] PATH_INFO: `/v3/projects/883b0a19bfca4429b0649c1a65487f3f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:57.232337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] RBAC: Authorizing `identity:get_project(project_id=883b0a19bfca4429b0649c1a65487f3f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:57.233803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741846d6-7b9d-4a5f-bbbc-b1cce5491980 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:57.235493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 568/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:40:57 2022] GET /identity/v3/projects/883b0a19bfca4429b0649c1a65487f3f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:57.242022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:57.345357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5874598e-0bb0-4d9e-9e6a-5b457cd89903 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:57.380482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:57.381277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:57.381561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:57.381832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:57.382659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] RBAC: Adding query filter params (role.id=69aab65303b34d8fa3995ff8bc58c38b, scope.project.id=883b0a19bfca4429b0649c1a65487f3f, user.id=8e246d486b864ba086a66c2aef01fe2b) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:40:57.382971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:57.384421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eeaa4-c382-4ef0-b788-0eafa9df3f7a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:57.390498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 562/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:40:57 2022] GET /identity/v3/role_assignments?user.id=8e246d486b864ba086a66c2aef01fe2b&scope.project.id=883b0a19bfca4429b0649c1a65487f3f&role.id=69aab65303b34d8fa3995ff8bc58c38b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:59.421211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1292-2d7c-46ec-bd73-c48c79a7ce91 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:59.421750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1292-2d7c-46ec-bd73-c48c79a7ce91 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:59.421750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1292-2d7c-46ec-bd73-c48c79a7ce91 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:59.423061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 569/1131] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:40:59.429487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:59.430199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:59.430344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:59.457103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:40:59.458291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:40:59.525729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:59.540676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 563/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:40:59.566865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1292-2d7c-46ec-bd73-c48c79a7ce91 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:59.654438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:40:59.682014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1292-2d7c-46ec-bd73-c48c79a7ce91 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:59.717102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:59.717880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:59.718127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:59.718426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:59.719611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:59.721078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181dba1-a607-4a08-8a5e-b0d004e7317a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:59.722681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 570/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:40:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:40:59.731879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:40:59.844160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fc590-1934-40ee-aac3-96c8dc9fe50d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:40:59.879125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:40:59.879777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:40:59.880062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:40:59.880334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:40:59.881072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:40:59.882537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64fce8-996b-479e-8638-a109d366e2a0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:40:59.913542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 564/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:40:59 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:41:01.955700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de77dd-97b6-41f8-8f91-d2cde55160c1 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:01.956610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de77dd-97b6-41f8-8f91-d2cde55160c1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:01.956610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de77dd-97b6-41f8-8f91-d2cde55160c1 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:01.958798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 571/1135] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:01.967437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:01.967851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:01.968025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:01.995812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:01.997127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:02.042799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:02.072138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 565/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:02.096726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de77dd-97b6-41f8-8f91-d2cde55160c1 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:02.212263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de77dd-97b6-41f8-8f91-d2cde55160c1 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:02.252201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:02.253017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:02.253298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:02.253547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:02.254875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:02.256399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860fb74-04b8-4932-b60f-56a28726863e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:02.257957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 572/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:41:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:02.264537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:02.361986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350bd09d-d2cd-4eec-bec5-4e40435462b2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:02.396962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:02.397617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:02.397894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:02.398165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:02.398867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:02.400316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69ce87-5142-451b-97eb-a2493f99602c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:02.424519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 566/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:41:02 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:41:04.457772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96537-a8d7-446a-af6e-e7216088212d None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:04.458644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96537-a8d7-446a-af6e-e7216088212d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:04.458644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b96537-a8d7-446a-af6e-e7216088212d None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:04.461019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 573/1139] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:04.466493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:04.466941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:04.467044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:04.485711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:04.486892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:04.515997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:04.562963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 567/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:41:04.588129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96537-a8d7-446a-af6e-e7216088212d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:04.611463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:04.705448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b96537-a8d7-446a-af6e-e7216088212d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:04.740232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:04.740999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:04.741282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:04.741550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:04.751613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:04.759066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:04.760155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:04.761841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 574/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:04.768440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:04.874681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb5af0-d9dd-439d-b9d3-cd11b4184d7b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:04.918210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:04.919083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:04.919362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:04.919634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:04.920384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:04.920693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:04.922148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:04.930463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 568/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:04.936571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:05.012558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:05.046312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da66339-4ede-4917-a5c9-4871c17dcaad None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:05.080994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:05.081869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:05.082150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:05.082423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] PATH_INFO: `/v3/users/da5c3a40284548848c36e1975fade89e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:05.095999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] RBAC: Authorizing `identity:get_user(user_id=da5c3a40284548848c36e1975fade89e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:05.097468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:05.099121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 575/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:04 2022] GET /identity/v3/users/da5c3a40284548848c36e1975fade89e => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:05.105255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:05.133993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:05.218225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979238e-abd8-4ab8-9c45-da219829cc27 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:05.256561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:05.257222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:05.257498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:05.257764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:05.330670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:05.332227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:05.360473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:05.445616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 569/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:41:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:41:05.453018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:05.560894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059726c6-bd39-49aa-b0e0-b58b308d2467 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:05.590957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:05.597799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:05.598657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:05.598941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:05.599213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] PATH_INFO: `/v3/projects/606f394021e3469d94df2e4a0702e2fc` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:05.600466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] RBAC: Authorizing `identity:get_project(project_id=606f394021e3469d94df2e4a0702e2fc)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:05.601938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd4d6e-f972-46e8-bfc8-939e081e9b96 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:05.603667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 576/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:05 2022] GET /identity/v3/projects/606f394021e3469d94df2e4a0702e2fc => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:05.610467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:05.710386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99db1f-cfa6-45f1-bdc1-7e8648bca7af None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:05.733587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:05.746133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:05.746767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:05.747045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:05.747316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:05.748136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=606f394021e3469d94df2e4a0702e2fc, user.id=da5c3a40284548848c36e1975fade89e) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:05.748444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:05.749901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592eb716-b521-43ca-a1f6-4e17f2b251f0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:05.755429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 570/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:41:05 2022] GET /identity/v3/role_assignments?user.id=da5c3a40284548848c36e1975fade89e&scope.project.id=606f394021e3469d94df2e4a0702e2fc&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:07.734022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547f61-c25d-48d0-9261-7571352a7430 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:07.734582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547f61-c25d-48d0-9261-7571352a7430 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:07.734582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5547f61-c25d-48d0-9261-7571352a7430 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:07.735941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 577/1147] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:07.742436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:07.743221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:07.743369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:07.768168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:07.769413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:07.839848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 571/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:07.862927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5547f61-c25d-48d0-9261-7571352a7430 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:07.977431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5547f61-c25d-48d0-9261-7571352a7430 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:08.012250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:08.013038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:08.013320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:08.013597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:08.023693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:08.031410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:08.032442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:08.033392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 578/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:08.039038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:08.141793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c00ae-d0ea-469a-930b-97ce0dfa24db None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:08.158740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:08.180105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:08.181235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:08.181678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:08.182102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:08.183288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:08.183785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:08.185213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:08.194706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 572/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:08.201120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:08.268695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:08.321530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ed21-15b9-4ef0-a7fd-2038c196b429 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:08.356340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:08.357266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:08.357546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:08.357818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] PATH_INFO: `/v3/users/da5c3a40284548848c36e1975fade89e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:08.359150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] RBAC: Authorizing `identity:get_user(user_id=da5c3a40284548848c36e1975fade89e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:08.360609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:08.362301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 579/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:08 2022] GET /identity/v3/users/da5c3a40284548848c36e1975fade89e => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:08.372398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:08.484201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca42d-b94d-4a35-b7a5-3b28ae6d3194 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:08.519513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:08.520292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:08.520569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:08.520865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] PATH_INFO: `/v3/projects/606f394021e3469d94df2e4a0702e2fc` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:08.522173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] RBAC: Authorizing `identity:get_project(project_id=606f394021e3469d94df2e4a0702e2fc)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:08.523623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2da102-5a30-464f-b739-f848814b955b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:08.525344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 573/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:08 2022] GET /identity/v3/projects/606f394021e3469d94df2e4a0702e2fc => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:08.535014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:08.645383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78477cb8-57fc-42f8-b373-7f8a4c224c07 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:08.671285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:08.681588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:08.682472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:08.682751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:08.683023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] PATH_INFO: `/v3/projects/606f394021e3469d94df2e4a0702e2fc/users/da5c3a40284548848c36e1975fade89e/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:08.685351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] RBAC: Authorizing `identity:create_grant(project_id=606f394021e3469d94df2e4a0702e2fc, user_id=da5c3a40284548848c36e1975fade89e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:08.686781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea0dee-83ee-44b3-8605-e6573a4d688c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:08.706676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 580/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:41:08 2022] PUT /identity/v3/projects/606f394021e3469d94df2e4a0702e2fc/users/da5c3a40284548848c36e1975fade89e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:41:10.671976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af8ca8-2d6e-4f10-8fe0-76242a0babee None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:10.672917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af8ca8-2d6e-4f10-8fe0-76242a0babee None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:10.672917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af8ca8-2d6e-4f10-8fe0-76242a0babee None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:10.675038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 574/1154] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:10.680502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:10.680948 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:10.681056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:10.699966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:10.701183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:10.777349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 581/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:10.807622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af8ca8-2d6e-4f10-8fe0-76242a0babee None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:10.870616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:10.929472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af8ca8-2d6e-4f10-8fe0-76242a0babee None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:10.967952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:10.968753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:10.969060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:10.969328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:10.980275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:10.988414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:10.989495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:41:10.993973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 575/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:10.998295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:11.101043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90def7-29af-41a1-83e6-d59f09aba4cd None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:11.117845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:11.142047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:11.142993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:11.143335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:11.143676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:11.144766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:11.145288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:11.147418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:11.157903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 582/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:11.166468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:11.272500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52121422-57e7-40ac-a09c-79eed946b914 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:11.281209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:11.310540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:11.311414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:11.311694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:11.311952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] PATH_INFO: `/v3/users/da5c3a40284548848c36e1975fade89e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:11.313257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] RBAC: Authorizing `identity:get_user(user_id=da5c3a40284548848c36e1975fade89e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:11.314737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:11.316708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 576/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:11 2022] GET /identity/v3/users/da5c3a40284548848c36e1975fade89e => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:41:11.322652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:11.432600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206296cb-bde5-46c6-b6ac-3dafa1a0943f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:11.467476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:11.468111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:11.468391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:11.468667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:11.518968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:11.550221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:11.551610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:11.659364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 583/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:41:11.668992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:11.778225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f20c5e-d5ba-4ecf-aca4-4cc7ae8eb060 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:11.813232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:11.814020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:11.814304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:11.814572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] PATH_INFO: `/v3/projects/606f394021e3469d94df2e4a0702e2fc` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:11.815790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] RBAC: Authorizing `identity:get_project(project_id=606f394021e3469d94df2e4a0702e2fc)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:11.817578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada132e-ec4e-4786-a724-318c8a09c340 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:11.819266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 577/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:11 2022] GET /identity/v3/projects/606f394021e3469d94df2e4a0702e2fc => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:11.825969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:11.917410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:11.942113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8718-7f1c-483b-9169-307aaa4f5e7d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:11.976858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:11.977496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:11.977774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:11.978040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:11.978856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=606f394021e3469d94df2e4a0702e2fc, user.id=da5c3a40284548848c36e1975fade89e) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:11.979164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:11.980665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4674e-4774-4e0c-98be-c8b969f4eca8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:11.987210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 584/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:41:11 2022] GET /identity/v3/role_assignments?user.id=da5c3a40284548848c36e1975fade89e&scope.project.id=606f394021e3469d94df2e4a0702e2fc&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:13.993136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ceae3-0b0b-48b9-8262-23e19218f948 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:13.993759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ceae3-0b0b-48b9-8262-23e19218f948 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:13.993759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ceae3-0b0b-48b9-8262-23e19218f948 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:13.995037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 578/1162] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:14.001825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:14.002562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:14.002699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:14.027556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:14.028746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:14.097544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 585/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:14.120124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ceae3-0b0b-48b9-8262-23e19218f948 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:14.182503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:14.243454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ceae3-0b0b-48b9-8262-23e19218f948 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:14.288013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:14.288663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:14.288980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:14.289257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:14.371718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:14.373221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:14.418552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:14.486297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 579/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:41:14.493605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:14.573393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:14.603193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa29463-d1ed-417a-acb2-0edf5bd0233e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:14.641244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:14.642030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:14.642308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:14.642573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:14.649548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:14.650980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-0c495bb6-5051-4d19-81b7-4e5ea41ddd85 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:14.665299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:14.666565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:14.668149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 586/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:41:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:14.672845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:14.775214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f123c87-c1a4-4bf7-bd1e-01a17d2ac143 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:14.810392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:14.811034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:14.811311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:14.811580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:14.812293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:14.812593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:14.814008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f00302-0f4b-44c7-ba1f-c9942eb9adb8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:14.821468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 580/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Mon Jun 20 14:41:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:16.808127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9de6e-6427-4c5a-bc39-aba5c06f8b36 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:16.808772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9de6e-6427-4c5a-bc39-aba5c06f8b36 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:16.808772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9de6e-6427-4c5a-bc39-aba5c06f8b36 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:16.810918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 587/1167] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:16.820061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac07f-248e-44c9-a378-bcd08d4c3546 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:16.820466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac07f-248e-44c9-a378-bcd08d4c3546 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:16.820688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac07f-248e-44c9-a378-bcd08d4c3546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:16.839841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c20ac07f-248e-44c9-a378-bcd08d4c3546 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:16.841108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c20ac07f-248e-44c9-a378-bcd08d4c3546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:16.843083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:16.914169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 581/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:16.937834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9de6e-6427-4c5a-bc39-aba5c06f8b36 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:17.046961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9de6e-6427-4c5a-bc39-aba5c06f8b36 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:17.076660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:17.082436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:17.083129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:17.083392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:17.083689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:17.084438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:17.085844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6dc0e4-f54d-42e2-a215-43af9fecb722 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:17.103023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 588/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Mon Jun 20 14:41:16 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:41:19.118796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257670db-6020-4f9c-98a9-d41b165ec218 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:19.119340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257670db-6020-4f9c-98a9-d41b165ec218 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:19.119340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257670db-6020-4f9c-98a9-d41b165ec218 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:19.120743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 582/1170] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:19.127079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:19.127852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:19.127980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:19.149586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:19.150780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:19.220616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 589/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:19.254116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257670db-6020-4f9c-98a9-d41b165ec218 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:19.362218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257670db-6020-4f9c-98a9-d41b165ec218 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:19.397129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:19.397983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:19.398266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:19.398537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] PATH_INFO: `/v3/domains/b2620b9dbdf64374a05dded1ce236b35` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:19.405545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:19.410574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] RBAC: Authorizing `identity:get_domain(domain_id=b2620b9dbdf64374a05dded1ce236b35)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:19.412041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa5b76-e24c-4fe9-b6c4-822c7eaf889a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:19.413732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 583/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Jun 20 14:41:19 2022] GET /identity/v3/domains/b2620b9dbdf64374a05dded1ce236b35 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:19.420419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:19.531151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337997ac-bc91-4f3d-83d7-30fc913c7279 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:19.554935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:19.569672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:19.570330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:19.570617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:19.570893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:19.571605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:19.573081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0464c89-a6f1-4180-81ee-b01a3201f687 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:19.599629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 590/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:41:19 2022] POST /identity/v3/projects => generated 361 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:41:21.617570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a283-5f4c-46a5-8b0d-16d2b5b837a8 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:21.618160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a283-5f4c-46a5-8b0d-16d2b5b837a8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:21.618160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a283-5f4c-46a5-8b0d-16d2b5b837a8 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:21.619483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 584/1174] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:21.626069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:21.626800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:21.626939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:21.654929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:21.656173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:21.725741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 591/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:21.758055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a283-5f4c-46a5-8b0d-16d2b5b837a8 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:21.875191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a283-5f4c-46a5-8b0d-16d2b5b837a8 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:21.910368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:21.911217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:21.911496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:21.911764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] PATH_INFO: `/v3/domains/b2620b9dbdf64374a05dded1ce236b35` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:21.913092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=b2620b9dbdf64374a05dded1ce236b35)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:21.914546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a0f15-c5fd-48cb-a57b-8fec85190c1a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:21.916194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 585/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Mon Jun 20 14:41:21 2022] GET /identity/v3/domains/b2620b9dbdf64374a05dded1ce236b35 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:21.922448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:22.026032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdca3e-1049-467b-a995-4c01b1f3ebc4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:22.028657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:22.068499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:22.069196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:22.069478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:22.069748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:22.070482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:22.071917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8442743-1bfe-4ae4-a546-fe6e17e8b672 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:22.097775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 592/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:41:21 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:41:24.145298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a01d9-f4c5-4ff0-abb7-894b60d91c8f None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.146174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a01d9-f4c5-4ff0-abb7-894b60d91c8f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.146174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a01d9-f4c5-4ff0-abb7-894b60d91c8f None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.148409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 586/1178] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:24.154879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.155516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.155656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.177167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:24.178668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:24.249173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 593/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:24.273439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a01d9-f4c5-4ff0-abb7-894b60d91c8f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:24.360121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:24.399474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a01d9-f4c5-4ff0-abb7-894b60d91c8f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:24.436183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:24.436996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.437276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.437553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.448901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:24.456432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:24.457562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:41:24.458727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 587/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:24.464071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:24.561509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:24.572968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8bde-76f2-4a65-b1a8-838514f8c4d3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:24.609236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:24.609897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.610246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.610429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.611205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:24.611516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:24.612915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:24.621965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 594/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:41:24.628112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:24.749615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f456ca1-6615-4dcc-8374-05f157285a3c None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:24.774784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:24.785581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:24.786435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.786712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.786981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] PATH_INFO: `/v3/users/7319a12d603a4bbc85757d9b098f0109` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.800317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=7319a12d603a4bbc85757d9b098f0109)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:24.801813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:24.803652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 588/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:24 2022] GET /identity/v3/users/7319a12d603a4bbc85757d9b098f0109 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:24.810370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:24.924273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4380-d59c-46ca-8ca9-525ffb118e1c None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:24.963197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:24.963848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:24.964311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:24.964852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:24.989671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:25.040982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:25.042745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:25.147290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 595/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:41:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:41:25.153564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:25.265547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a3809-8eda-4c29-8fec-482433e54ce7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:25.304385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:25.305265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:25.305545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:25.305821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] PATH_INFO: `/v3/projects/b447180f475f4ce1a076134c1008c1ef` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:25.307017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] RBAC: Authorizing `identity:get_project(project_id=b447180f475f4ce1a076134c1008c1ef)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:25.308553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e48882-fc1a-42b1-9760-3cdb9c5517f0 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:25.310294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 589/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:25 2022] GET /identity/v3/projects/b447180f475f4ce1a076134c1008c1ef => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:25.316738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:25.381971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:25.432107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24b74-4092-45c6-9031-b018ad9b0495 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:25.468111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:25.468765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:25.469046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:25.469323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:25.470152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=b447180f475f4ce1a076134c1008c1ef, user.id=7319a12d603a4bbc85757d9b098f0109) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:25.470460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:25.471886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b3a3e-2139-4c0d-89db-854d79232099 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:25.477473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 596/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:41:25 2022] GET /identity/v3/role_assignments?user.id=7319a12d603a4bbc85757d9b098f0109&scope.project.id=b447180f475f4ce1a076134c1008c1ef&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:27.510290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc508469-35b9-41b1-8c64-fe4bc5193942 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:27.510880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc508469-35b9-41b1-8c64-fe4bc5193942 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:27.510880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc508469-35b9-41b1-8c64-fe4bc5193942 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:27.512750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 590/1186] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:27.519323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:27.520015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:27.520206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:27.540747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:27.541962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:27.612249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 597/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:27.635817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc508469-35b9-41b1-8c64-fe4bc5193942 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:27.702529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:27.752923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc508469-35b9-41b1-8c64-fe4bc5193942 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:27.788291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:27.789048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:27.789333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:27.789605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:27.800626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:27.808852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:27.809899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:41:27.810727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 591/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:27.816981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:27.862718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:27.918843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb237d-534f-4da7-a458-04a4e46a23fd None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:27.954785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:27.955444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:27.955725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:27.955994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:27.956766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:27.957059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:27.958426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:27.966720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 598/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:27.975957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:28.084883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809289c4-d2d3-401c-96a4-089d7c6c17c4 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:28.097431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:28.123869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:28.124749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:28.125047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:28.125316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] PATH_INFO: `/v3/users/7319a12d603a4bbc85757d9b098f0109` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:28.126538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] RBAC: Authorizing `identity:get_user(user_id=7319a12d603a4bbc85757d9b098f0109)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:28.127985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:28.129636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 592/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:27 2022] GET /identity/v3/users/7319a12d603a4bbc85757d9b098f0109 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:28.136477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:28.249697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa586e-5dc6-42eb-9413-6aa52eaa094d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:28.258629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:28.284380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eda041-e803-4581-86f8-b343625306de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:28.285262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda041-e803-4581-86f8-b343625306de None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:28.285544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda041-e803-4581-86f8-b343625306de None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:28.285816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda041-e803-4581-86f8-b343625306de None admin] PATH_INFO: `/v3/projects/b447180f475f4ce1a076134c1008c1ef` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:28.287037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eda041-e803-4581-86f8-b343625306de None admin] RBAC: Authorizing `identity:get_project(project_id=b447180f475f4ce1a076134c1008c1ef)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:28.288460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eda041-e803-4581-86f8-b343625306de None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:28.290307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 599/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:28 2022] GET /identity/v3/projects/b447180f475f4ce1a076134c1008c1ef => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:28.299049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:28.406633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99507ca5-f25c-481e-bc06-ef6928232d69 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:28.441581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:28.442467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:28.442746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:28.443023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] PATH_INFO: `/v3/projects/b447180f475f4ce1a076134c1008c1ef/users/7319a12d603a4bbc85757d9b098f0109/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:28.445130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] RBAC: Authorizing `identity:create_grant(project_id=b447180f475f4ce1a076134c1008c1ef, user_id=7319a12d603a4bbc85757d9b098f0109, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:28.446593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d34578-b428-4e06-ab72-261b0730f63c None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:28.465643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 593/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:41:28 2022] PUT /identity/v3/projects/b447180f475f4ce1a076134c1008c1ef/users/7319a12d603a4bbc85757d9b098f0109/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:41:30.431612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc05f3-b078-42cd-bfd8-55be37d200c9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:30.432436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc05f3-b078-42cd-bfd8-55be37d200c9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:30.432436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc05f3-b078-42cd-bfd8-55be37d200c9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:30.434112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 600/1193] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:41:30.439590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:30.440026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:30.440118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:30.460475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:41:30.461702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:41:30.498884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:30.537734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 594/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:41:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:41:30.561338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc05f3-b078-42cd-bfd8-55be37d200c9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:30.676291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc05f3-b078-42cd-bfd8-55be37d200c9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:30.712067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38610507-fa05-4476-8e85-4f555313147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:30.712832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610507-fa05-4476-8e85-4f555313147d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:30.713116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610507-fa05-4476-8e85-4f555313147d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:30.713479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38610507-fa05-4476-8e85-4f555313147d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:30.724264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38610507-fa05-4476-8e85-4f555313147d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-38610507-fa05-4476-8e85-4f555313147d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:41:30.731885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:41:30.732975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:41:30.733791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 601/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:41:30.739341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:30.848678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c0a83-0c4e-4d66-aa9b-819b51c6b095 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:30.884129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:30.884770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:30.885082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:30.885331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:30.886177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:30.886609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:30.888013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:30.896080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 595/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:30.905388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38610507-fa05-4476-8e85-4f555313147d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:30.940931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:31.009766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38610507-fa05-4476-8e85-4f555313147d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:31.046017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:31.046879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:31.047152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:31.047417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] PATH_INFO: `/v3/users/7319a12d603a4bbc85757d9b098f0109` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:31.048755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] RBAC: Authorizing `identity:get_user(user_id=7319a12d603a4bbc85757d9b098f0109)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:31.050223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:31.051855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 602/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Mon Jun 20 14:41:30 2022] GET /identity/v3/users/7319a12d603a4bbc85757d9b098f0109 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:31.061182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:31.100042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:31.175175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7285eb-ceea-4639-b6fe-f802b8b49eb6 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:31.209865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:31.210511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:31.210788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:31.211060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:31.291959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:31.293394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:31.324134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:31.394744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 596/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:41:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:41:31.401545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:31.514914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade934d-3b7d-48f6-94e7-82d198cea297 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:31.517410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:31.550196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:31.551011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:31.551288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:31.551561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] PATH_INFO: `/v3/projects/b447180f475f4ce1a076134c1008c1ef` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:31.552770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] RBAC: Authorizing `identity:get_project(project_id=b447180f475f4ce1a076134c1008c1ef)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:31.554227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47e946-3bd8-4bf1-9e22-d763fb7805e2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:31.555912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 603/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Mon Jun 20 14:41:31 2022] GET /identity/v3/projects/b447180f475f4ce1a076134c1008c1ef => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:31.563782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:41:31.669580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4666de-9991-4659-8af4-7c4f31d16921 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:41:31.700070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:31.706218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:41:31.706871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:41:31.707154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:41:31.707424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:41:31.708248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=b447180f475f4ce1a076134c1008c1ef, user.id=7319a12d603a4bbc85757d9b098f0109) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:41:31.708559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:41:31.710069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d77b-2bd3-491a-978d-1a802fdb3379 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:41:31.716426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 597/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:41:31 2022] GET /identity/v3/role_assignments?user.id=7319a12d603a4bbc85757d9b098f0109&scope.project.id=b447180f475f4ce1a076134c1008c1ef&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:41:41.545544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=14 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:41:41.713469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:27.028751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4f14-bfc0-4719-81e0-a94989a57cfb None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:27.028751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4f14-bfc0-4719-81e0-a94989a57cfb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:27.028751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4f14-bfc0-4719-81e0-a94989a57cfb None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:27.031417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 604/1201] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:27.037013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:27.037526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:27.037526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:27.056837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:27.058071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:27.149167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 598/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:27.175484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f4f14-bfc0-4719-81e0-a94989a57cfb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:27.310224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f4f14-bfc0-4719-81e0-a94989a57cfb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:27.353159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:27.354037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:27.354305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:27.354580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:27.365678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:27.367121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:27.385880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:27.387036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:27.387981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:27.387981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:27.387981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:27.387981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:27.387981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 605/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:27.393539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:27.517077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d0f08-7b3b-4d76-a169-84ff5f5299a2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:27.558294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:27.565926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:27.566682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:27.567038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:27.567522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:27.568295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:27.568611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:27.571252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeaaf6-182d-4e34-ba08-d9c24b2cebc1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:27.585034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 599/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:27.591053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:27.654598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:27.717686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d806222-902b-4a9f-a551-1d038a8e3e8f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:27.776492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:27.777300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:27.777579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:27.777921 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:27.778662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:27.780206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ca9f2-6d8e-4459-b6a7-959f7258cd17 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:27.807305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 606/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Mon Jun 20 14:42:27 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:42:30.099848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f3fb-277f-4536-8d33-bdd1a26c6124 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:30.100466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f3fb-277f-4536-8d33-bdd1a26c6124 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:30.100466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3f3fb-277f-4536-8d33-bdd1a26c6124 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:30.102074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 600/1206] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:30.109991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:30.109991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:30.109991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:30.128478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:30.129731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:30.226350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 607/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:30.251801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f3fb-277f-4536-8d33-bdd1a26c6124 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:30.377179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3f3fb-277f-4536-8d33-bdd1a26c6124 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:30.414143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:30.415049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:30.415441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:30.415643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:30.427672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:30.436979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:30.438297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:30.439384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:30.443767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 601/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:30.444927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:30.488337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:30.562426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfea7-2273-4b75-8575-1bb820131acf None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:30.602207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:30.602909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:30.603227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:30.603524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:30.604365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:30.604688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:30.606182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:30.615203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 608/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:30.621981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:30.681944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:30.754780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efc0b9-7a7f-4cb1-bb6e-f185d8668098 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:30.795370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:30.796176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:30.796464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:30.796807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:30.811055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:30.812602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:30.833385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:30.834680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:30.835763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:30.835763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:30.835763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:30.835763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:30.841026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:30.842147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 602/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:30.965900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:30.969026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae4257-9f1b-4267-bba9-7dea41c33e8d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:31.007265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:31.007984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:31.008273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:31.008600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:31.009673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:31.009988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:31.011437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:31.029063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 609/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:31.030777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:31.148995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e143f62-12d2-4e45-bf4d-699b38fdf72b None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:31.154830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:31.201020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:31.201878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:31.202399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:31.202701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:31.214011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:31.214623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:31.233659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:31.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:31.235931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 603/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:42:31.241289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:31.351572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be7aea-9434-4209-8837-e54ea375412d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:31.396382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:31.397184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:31.397571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:31.397913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:31.398836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:31.399215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:31.401139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:31.421898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 610/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:31.427702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:31.547349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cadd8-f7f4-4754-a91b-77b9ae348ae7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:31.588337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:31.589036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:31.589346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:31.589597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:31.625403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:31.673005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:31.674958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:31.791723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 604/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:42:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 20 14:42:31.797705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:31.819695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:31.913544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9664ee-4c5d-4a87-932c-4407eef0b62e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:31.966268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:31.967303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:31.967710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:31.968105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:31.981460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:31.983115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:32.004365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:32.005643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:32.007624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:32.007624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:32.007624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:32.007624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:32.007624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 611/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:42:32.012835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:32.083610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:32.133035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a8019-250e-4a0e-b757-cd23881943ec None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:32.169748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:32.172593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:32.172593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:32.172593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:32.172593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:32.172593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:32.173322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:32.185451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 605/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:32.191455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:32.263183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:32.295579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80387de1-fa97-4c3d-b525-3c87ca5a70fa None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:32.336682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:32.337497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:32.337776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:32.338055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:32.345336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:32.346863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:32.361345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:32.362294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:32.368388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 612/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:32.368982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:32.479929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a993f39-fda7-4ae4-8c17-a4bead29d002 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:32.505047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:32.518810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:32.519472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:32.519750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:32.520019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:32.520833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:32.521142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:32.522590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc18cd8d-52a9-47e3-a95d-ff2cb25f0689 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:32.535390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 606/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:32.542061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:32.662782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0926-f9a8-46b3-9e31-d1edc2e59cd4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:32.700294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:32.710257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:32.711032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:32.711405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:32.711794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:32.712815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=1a352ef3c0df4e4ea94f3a76b96abb87) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:32.713218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:32.714785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83592b7e-0699-4faf-8b6b-e059ac520c94 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:32.728131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 613/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:42:32 2022] GET /identity/v3/role_assignments?user.id=1a352ef3c0df4e4ea94f3a76b96abb87&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:34.963506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74662710-dfd6-42a2-b6bb-84515a3954cf None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:34.964113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74662710-dfd6-42a2-b6bb-84515a3954cf None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:34.964113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74662710-dfd6-42a2-b6bb-84515a3954cf None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:34.965811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 607/1220] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:34.971781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:34.972280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:34.972393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:34.991545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:34.992823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:35.072904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 614/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:35.098650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74662710-dfd6-42a2-b6bb-84515a3954cf None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:35.212395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74662710-dfd6-42a2-b6bb-84515a3954cf None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:35.249149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:35.249940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:35.250258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:35.250565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:35.261869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:35.270440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:35.271524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:35.277995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 608/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:35.278861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:35.384477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6120bb9-159b-45dc-86b1-05e77d4547cb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:35.407603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:35.418778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:35.419502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:35.419786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:35.420059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:35.420878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:35.421187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:35.422623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:35.431894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 615/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:35.437545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:35.483699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:35.544201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff86759-b984-4d56-ae8d-68a565881299 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:35.579483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:35.580280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:35.580590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:35.580895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:35.591337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:35.592832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:35.610411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:35.611465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:35.612693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:35.612693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:35.612693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:35.612693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:35.612693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 609/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:35.617679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:35.729189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ca167-4e95-477d-93d3-c908f9db7bb8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:35.767657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:35.768325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:35.768603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:35.768904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:35.769629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:35.769934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:35.771299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:35.783185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 616/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:35.789028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:35.885988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:35.894250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126359f-52ad-42eb-8ca6-50ed43417844 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:35.932691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:35.933591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:35.933925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:35.934230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:35.942360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:35.943836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:35.959959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:35.960992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:35.962035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:35.967870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 610/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:35.968430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.023060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:36.079319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424b8f-3ad3-417b-b9a1-e67a0b28efb1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:36.113931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:36.114635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:36.114911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:36.115185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:36.116044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:36.116372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:36.117833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:36.140266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 617/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:36.145976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.255839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64796b-0a41-4ff9-a7f3-ede36ebda3e1 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:36.291854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:36.292696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:36.293009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:36.293285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:36.304089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:36.305574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:36.324386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:36.325616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:36.331942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:36.331942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:36.331942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:36.331942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:36.331942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 611/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:36.333043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.445222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07792403-0bff-4ab7-89d2-d9459b2efe5a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:36.448003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:36.483965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:36.484744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:36.485071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:36.485368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:36.486143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:36.486480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:36.488132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:36.500936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 618/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:36.506807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.517187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:36.623144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff138f-635b-45cb-bb85-950d64a1ab4f None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:36.661010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:36.661897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:36.662177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:36.662455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:36.670117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:36.671750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:36.687393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:36.688473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:36.689555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 612/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:36.694943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.807731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548086de-6700-411a-8f91-789102f7cbe9 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:36.842209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:36.842879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:36.843158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:36.843432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:36.844226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:36.844533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:36.846022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d329d1-fb42-4226-bb60-940ed2d66db7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:36.859386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 619/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:36.866299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:36.936289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:36.977161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638dcf24-ce66-4787-9568-843cf7d63afe None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:37.016045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:37.017160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:37.017539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:37.017887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/1a352ef3c0df4e4ea94f3a76b96abb87/roles/70791d5382a84496a98a0a0a088915fb` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:37.036072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=1a352ef3c0df4e4ea94f3a76b96abb87, role_id=70791d5382a84496a98a0a0a088915fb)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:37.037815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb58c1-f8cd-4e83-8068-4ae4e08504d1 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:37.054005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 613/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:42:36 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/1a352ef3c0df4e4ea94f3a76b96abb87/roles/70791d5382a84496a98a0a0a088915fb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:42:39.130891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb669f-d930-4cc3-9996-82e1f66a8599 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.131518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb669f-d930-4cc3-9996-82e1f66a8599 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.131518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb669f-d930-4cc3-9996-82e1f66a8599 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.133126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 620/1233] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:39.139050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.139584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.139681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.156466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:39.157705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:39.225582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 614/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:39.249874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb669f-d930-4cc3-9996-82e1f66a8599 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:39.278377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:39.363016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb669f-d930-4cc3-9996-82e1f66a8599 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:39.401701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:39.402616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.402894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.403164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.414236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:39.422697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:39.423900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:39.424821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 621/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Mon Jun 20 14:42:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:39.430285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:39.481295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:39.541712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee705a71-a9c7-45a0-b909-2699d203e7c3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:39.579461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:39.580292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.580683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.580977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.581743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] RBAC: Adding query filter params (name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:39.582047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:39.583426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:39.592040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 615/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Mon Jun 20 14:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:39.597753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:39.685753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:39.703205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdd9b8-f696-440d-862e-0dfe8474c567 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:39.741198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:39.742163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.742493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.742842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.756559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:39.758283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:39.779584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:39.780827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:39.782085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:39.782085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:39.782085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:39.782085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:39.782085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 622/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:39.786823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:39.895755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae2d2d-35a8-4532-8be4-8069f71b6c53 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:39.906000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:39.932809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:39.933476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:39.933759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:39.934032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:39.934761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:39.935067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:39.936454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:39.949294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 616/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:39.955182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:40.072149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74683b1a-8553-4e2f-ac58-84c21ec5ceaf None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:40.109553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:40.110461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:40.110827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:40.111156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:40.115083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:40.121638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:40.123412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:40.138311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:40.139992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:40.141304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:40.146046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 623/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:40.146173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:40.267475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144392f2-32a9-4fb7-ad95-6fb8290b9bb8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:40.308590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:40.309292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:40.309568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:40.309877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:40.310706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:40.311028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:40.312424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:40.332150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 617/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:40.338993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:40.453018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf353d-d686-42d1-9049-93534d851ee7 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:40.490023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:40.490722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:40.491116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:40.491355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:40.558659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:40.565945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:40.567398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:40.684249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 624/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:42:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:42:40.690927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:40.722258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:40.811555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6865bbd1-8f6c-4d7a-8f4b-fe8bdb7beeef None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:40.848755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:40.849584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:40.849913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:40.850193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:40.863128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:40.864869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:40.886239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:40.887318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:40.893225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:40.893225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:40.893225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:40.893225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:40.893225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 618/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:40.893751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:40.998277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:41.005238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86124a-9a8d-4257-b00b-147785a17290 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:41.045748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:41.046455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:41.046737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:41.047008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:41.047739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:41.048042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:41.049472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:41.062145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 625/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:41.068650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:41.159246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:41.181505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0382-8daf-4ecf-adeb-3dbdbe702c40 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:41.216179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:41.217175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:41.217541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:41.217904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:41.224792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:41.226263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:41.240483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:41.241587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:41.242671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 619/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:41.247847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:41.353015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118be3-5d50-47ab-9986-190f651a8d5f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:41.389847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:41.390533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:41.390805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:41.391104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:41.391993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:41.392305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:41.393959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d8f8-17b7-4357-b5c1-4a50cc5f3c9b None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:41.408069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 626/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:41.414335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:41.525222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b4575-536d-4cde-8831-f8cd40a1321d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:41.559683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:41.560431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:41.560736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:41.561056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:41.561894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] RBAC: Adding query filter params (role.id=70791d5382a84496a98a0a0a088915fb, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=1a352ef3c0df4e4ea94f3a76b96abb87) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:41.562252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:41.563849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d5f21-094f-431e-9055-abbf755a7f84 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:41.570715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 620/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:42:41 2022] GET /identity/v3/role_assignments?user.id=1a352ef3c0df4e4ea94f3a76b96abb87&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=70791d5382a84496a98a0a0a088915fb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:43.629863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7755d-bea3-4af9-a116-4cb76de846e5 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:43.630467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7755d-bea3-4af9-a116-4cb76de846e5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:43.630467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7755d-bea3-4af9-a116-4cb76de846e5 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:43.632465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 627/1247] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:43.638464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:43.638907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:43.639017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:43.644274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:43.657668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:43.659094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:43.752754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 621/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:42:43.773374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7755d-bea3-4af9-a116-4cb76de846e5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:43.795897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:43.889523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7755d-bea3-4af9-a116-4cb76de846e5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:43.927092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:43.927919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:43.928200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:43.928474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:43.940663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:43.948529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:43.949750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:43.950743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 628/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:43.956244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.069371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a6261-3590-49d9-91d0-47773eb0ac81 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:44.100817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:44.106896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:44.107674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:44.107951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:44.108258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:44.109165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:44.109468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:44.111028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:44.120461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 622/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:42:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:44.126264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.211350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:44.237967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f93949-24b2-49dc-8f49-e43efbf20803 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:44.276535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:44.277369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:44.277656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:44.277940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:44.290369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:44.291852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:44.310407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:44.311513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:44.317486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:44.317486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:44.317486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:44.317486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:44.317486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 629/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:44.317942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.429131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba14cfe-5d80-4873-9f46-75232074e1e7 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:44.474993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:44.476023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:44.476330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:44.476892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:44.478167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:44.478489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:44.479873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:44.496610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 623/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:44.503047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.612485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae66f4-07b1-4ada-abf3-431cabab97d2 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:44.641790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:44.651245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:44.652049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:44.652322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:44.652601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:44.660533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:44.662072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:44.676859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:44.678041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:44.679567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 630/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:44.684076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.746717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:44.798792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cde3a-de2b-4987-b4f0-de58977fd7e8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:44.836695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:44.837393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:44.837694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:44.837977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:44.838893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:44.839238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:44.840745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:44.858880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 624/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:44.865015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:44.970834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28d03-2408-413a-98bf-88807675f2dc None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:45.007895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:45.008637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:45.008957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:45.009236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:45.072172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:45.086047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:45.087873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:45.200956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 631/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:42:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:42:45.201922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:45.337109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396e685-ffb9-4dec-9d35-d5686cca5da9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:45.352529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:45.382821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:45.384099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:45.384892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:45.385326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:45.397813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:45.399676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:45.419994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:45.421290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:45.422271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:45.422271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:45.422271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:45.422271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:45.422271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 625/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:45.427047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:45.527071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:45.539106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ffd08-a7da-44b9-9353-c7b12f064cc1 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:45.574649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:45.575361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:45.575626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:45.575897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:45.576623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:45.576956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:45.578338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:45.589908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 632/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:45.595772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:45.701823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98b727-fc82-4339-a25a-9a6867f9ce78 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:45.741707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:45.742834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:45.743274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:45.743634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:45.754079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:45.756496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:45.775829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:45.777215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:45.778444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:45.783099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 626/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:45.784142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:45.893944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f88a2-9679-45f9-9a51-a5332437559e None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:45.930700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:45.931541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:45.931824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:45.932118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:45.933084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:45.933391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:45.935009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5184bd-7a0d-4d65-a1d8-d9bb162186da None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:45.949194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 633/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:45.955764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:45.983611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:46.068403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca616d-d8bb-450c-ab2b-869e3f54c343 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:46.104336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:46.105074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:46.105339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:46.105608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:46.106430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=1a352ef3c0df4e4ea94f3a76b96abb87) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:46.106744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:46.108191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8f1c-eeed-4633-aeac-3e095c71ca48 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:46.114148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 627/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:42:45 2022] GET /identity/v3/role_assignments?user.id=1a352ef3c0df4e4ea94f3a76b96abb87&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:48.128011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119f33-e448-41d3-affb-72cc37fe0109 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.128552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119f33-e448-41d3-affb-72cc37fe0109 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.128552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47119f33-e448-41d3-affb-72cc37fe0109 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.129977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 634/1261] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:48.136313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.137065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.137230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.164130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:48.165711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:48.234196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 628/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:48.257275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47119f33-e448-41d3-affb-72cc37fe0109 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:48.268750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:48.371313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47119f33-e448-41d3-affb-72cc37fe0109 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:48.406834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:48.407616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.407899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.408178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.419496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:48.427074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:48.428128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:48.429199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 635/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:48.434735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:48.454766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:48.538493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f84b76-cc14-481f-83e2-15b3a460b1eb None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:48.573810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:48.574466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.574742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.575015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.575764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:48.576069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:48.577491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:48.585781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 629/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:48.592471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:48.675555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:48.710592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e11ea-5fa7-48e7-aa57-2c05e7ef1a77 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:48.757391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:48.758351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.758914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.759172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.772462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:48.774381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:48.795950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:48.797035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:48.798245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:48.798245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:48.798245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:48.798245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:48.798245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 636/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:48.803807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:48.887203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:48.907232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f5891-15e5-4d47-ac10-14a5b27b7648 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:48.940595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:48.941280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:48.941530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:48.941832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:48.942542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:48.942839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:48.944221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:48.956279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 630/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:48.964854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.076625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8808-1028-4e3f-a222-4a7309607131 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:49.097024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:49.114045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:49.114853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:49.115137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:49.115412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:49.124098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:49.125589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:49.139822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:49.141397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:49.142475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 637/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:49.147664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.255615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea325b-ca7c-4f24-8603-d01386a3ffeb None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:49.301276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:49.302282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:49.302599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:49.303056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:49.304396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:49.304807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:49.306524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:49.318614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:49.332322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 631/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:49.341582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.460456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6065-b964-46a9-a027-9a28bbd67470 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:49.495725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:49.496508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:49.496817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:49.497099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:49.507855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:49.509339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:49.526387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:49.527375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:49.529006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:49.529006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:49.529006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:49.529006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:49.529006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 638/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:49.535961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.639001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7919dba-d6f4-4377-9e1a-a82cf467575a None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:49.676739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:49.677882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:49.678356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:49.678833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:49.679905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:49.680239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:49.682222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:49.694557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 632/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:49.703113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.741304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:49.819496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb1a49-05ac-4367-b765-591bf61d6aee None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:49.854497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:49.855286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:49.855567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:49.855842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:49.862887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:49.864325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:49.878746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:49.879728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:49.880906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 639/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 20 14:42:49.886553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:49.953003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:49.997351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f781f51-403c-4e5e-aa28-a9a21f10f20d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:50.041825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:50.042497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:50.042776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:50.043048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:50.043835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:50.044144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:50.045635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98215060-024f-4836-bd8c-dcf8099c5c61 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:50.057777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 633/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:50.063932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:50.159011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:50.169202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07b7b-2c69-45e3-806f-fe6bced7ff3d None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:50.209462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:50.210339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:50.210621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:50.210894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] PATH_INFO: `/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/1a352ef3c0df4e4ea94f3a76b96abb87/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:50.213185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] RBAC: Authorizing `identity:create_grant(project_id=80dfb8b8c228411ab455ca5f6024a298, user_id=1a352ef3c0df4e4ea94f3a76b96abb87, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:50.214621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b828fea-a8e8-4f15-aaaa-2fe069b72026 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:50.230066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 640/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Mon Jun 20 14:42:50 2022] PUT /identity/v3/projects/80dfb8b8c228411ab455ca5f6024a298/users/1a352ef3c0df4e4ea94f3a76b96abb87/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:42:52.203402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883b10-a9de-4e10-9666-91d0240c517c None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:52.204291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883b10-a9de-4e10-9666-91d0240c517c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:52.204291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53883b10-a9de-4e10-9666-91d0240c517c None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:52.206598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 634/1274] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:52.212921 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:52.213367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:52.213666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:52.240806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:52.242702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:52.327015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 641/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:52.351040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883b10-a9de-4e10-9666-91d0240c517c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:52.471113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53883b10-a9de-4e10-9666-91d0240c517c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:52.491001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:52.508908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:52.509687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:52.509962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:52.510230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:52.520918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 20 14:42:52.528520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:52.529536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:52.530400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 635/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Mon Jun 20 14:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:52.535950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:52.620696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:52.641691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc06132-b57b-41a6-84c4-61318e1d85c2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:52.678042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:52.678696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:52.678977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:52.679248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:52.679987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:52.680315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:52.681914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:52.690106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 642/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Mon Jun 20 14:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:52.696963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:52.805835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc33ad4-55db-4a28-9341-99eed0740989 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:52.840891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:52.841675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:52.841955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:52.842225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:52.853029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:52.854509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:52.871804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:52.872825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:52.873884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:52.873884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:52.873884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:52.873884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:52.873884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 636/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:52.879345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:52.996266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a90de-39f5-46ad-894a-ac88916a6f7f None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:53.031973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:53.032635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:53.032955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:53.033219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:53.033936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:53.034241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:53.035612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:53.047636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 643/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:53.053518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:53.085845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:53.170423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307029fc-1bdc-41ad-8985-ce88c5948163 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:53.211033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:53.211947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:53.212227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:53.212496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] PATH_INFO: `/v3/users/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:53.220607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:53.222249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 20 14:42:53.237040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:53.238068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:53.239026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 637/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:53.244309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:53.248415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:53.349498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed945187-6b6b-4daf-9e96-6b14a0f1bf7a None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:53.387390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:53.388368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:53.388788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:53.389274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:53.390552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:53.390992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:53.393283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:53.420943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 644/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Mon Jun 20 14:42:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:53.429981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:53.535021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:53.546000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562b4b0-a2ed-47db-b5ba-da2c276337bf None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:53.590533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:53.591182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:53.591461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:53.591733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:53.659848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:53.661355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:53.756983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:53.774122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 638/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Mon Jun 20 14:42:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 20 14:42:53.779972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:53.846272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:53.885905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d8fd3-fb25-4785-b658-67e38ef78cb4 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:53.923215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:53.923996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:53.924276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:53.924553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:53.934991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:53.936420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 20 14:42:53.954242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:53.955261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:53.956138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 20 14:42:53.956138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 20 14:42:53.956138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 20 14:42:53.956138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:53.956138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 645/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:53.961694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:54.075115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbae86f-832a-447a-967f-eb5c9c9d2908 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:54.110737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:54.111391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:54.111669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:54.111941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:54.112660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:54.112992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:54.114385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:54.125629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 639/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Mon Jun 20 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:54.131525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:54.242171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da87bc1-b8d8-4265-971c-d986ec8675f8 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:54.264468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:54.293357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:54.294078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:54.294353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:54.294630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:54.301453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:54.302904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 20 14:42:54.316867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:54.317878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 20 14:42:54.318911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: ERROR keystone.server.flask.application Jun 20 14:42:54.321168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 646/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Mon Jun 20 14:42:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:54.324554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:54.380281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:54.430829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0336d38-06ef-4646-8b3b-e0cc03d579a9 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:54.466993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:54.467641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:54.467921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:54.468196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:54.469012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:54.469324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:54.470778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ceb8a-b410-4aaf-8cae-43efa4ed54c3 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:54.482775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 640/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Mon Jun 20 14:42:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:54.489236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:54.600494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70326e9-de92-46c9-af10-f6436a7ebfc3 None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:54.639601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:54.640255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:54.640536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:54.640846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:54.641678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] RBAC: Adding query filter params (role.id=695e03655fc54138a800137878e15659, scope.project.id=80dfb8b8c228411ab455ca5f6024a298, user.id=1a352ef3c0df4e4ea94f3a76b96abb87) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:54.641991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:54.643439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab71b48-2950-4f72-8136-90bc5cad82df None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:54.650527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 647/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Mon Jun 20 14:42:54 2022] GET /identity/v3/role_assignments?user.id=1a352ef3c0df4e4ea94f3a76b96abb87&scope.project.id=80dfb8b8c228411ab455ca5f6024a298&role.id=695e03655fc54138a800137878e15659 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:56.666545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1a8b-6ae4-4afd-a5e2-eddfcf8a54e1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:56.667132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1a8b-6ae4-4afd-a5e2-eddfcf8a54e1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:56.667132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c1a8b-6ae4-4afd-a5e2-eddfcf8a54e1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:56.668478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 641/1288] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:42:56.674760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:56.675473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:56.675675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:56.698086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:56.699290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:56.736847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:56.778951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 648/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:42:56.801724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c1a8b-6ae4-4afd-a5e2-eddfcf8a54e1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:56.911125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c1a8b-6ae4-4afd-a5e2-eddfcf8a54e1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:56.922103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:56.952271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c601a8-7011-4447-8793-184114034082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:56.953087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c601a8-7011-4447-8793-184114034082 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:56.953374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c601a8-7011-4447-8793-184114034082 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:56.953641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c601a8-7011-4447-8793-184114034082 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:56.954287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c601a8-7011-4447-8793-184114034082 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:56.955676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c601a8-7011-4447-8793-184114034082 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-a7c601a8-7011-4447-8793-184114034082 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:42:56.968018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:42:56.969195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:42:56.970086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 642/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:42:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:42:56.975433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:57.077844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364e97d3-c79c-4996-858c-329ac369b442 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:57.121151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:57.122106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:57.122503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:57.122875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:57.123974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:57.124394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:57.126532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f731c63-0e14-4a5a-bbda-4d1d660376e5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:57.134197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 649/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jun 20 14:42:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:42:57.140910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c601a8-7011-4447-8793-184114034082 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:57.258222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c601a8-7011-4447-8793-184114034082 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:57.296548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:57.297230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:57.297509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:57.297805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] PATH_INFO: `/v3/services` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:57.298714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] RBAC: Adding query filter params (type=placement) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:42:57.299020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:57.300401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147bc6a-885d-4f6b-8f2c-10a6ac50af0b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:57.305583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 643/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jun 20 14:42:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:42:59.406973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453077-e4eb-4a22-a066-a7ea6962790e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:59.407835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453077-e4eb-4a22-a066-a7ea6962790e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:59.407835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51453077-e4eb-4a22-a066-a7ea6962790e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:59.409964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 650/1293] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:42:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:42:59.417384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0f26f-d9b9-4a86-a0f3-929dbc9af577 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:59.417843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0f26f-d9b9-4a86-a0f3-929dbc9af577 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:59.417935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0f26f-d9b9-4a86-a0f3-929dbc9af577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:59.436368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e8c0f26f-d9b9-4a86-a0f3-929dbc9af577 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:42:59.437611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e8c0f26f-d9b9-4a86-a0f3-929dbc9af577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:42:59.469077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:59.524464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 644/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:42:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 20 14:42:59.553199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453077-e4eb-4a22-a066-a7ea6962790e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:42:59.589817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:42:59.668985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51453077-e4eb-4a22-a066-a7ea6962790e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:42:59.713514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:42:59.714179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:42:59.714465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:42:59.714772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:42:59.715598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:42:59.717003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477eda73-da24-4c29-afd1-257016bfff2f None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:42:59.752745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 651/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Mon Jun 20 14:42:59 2022] POST /identity/v3/services => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:43:01.744536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b00ec-9f2e-4e27-8a2f-c2c779c27d5b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:01.745441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b00ec-9f2e-4e27-8a2f-c2c779c27d5b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:01.745441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b00ec-9f2e-4e27-8a2f-c2c779c27d5b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:01.747722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 645/1296] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:43:01.754145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:01.754822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:01.754999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:01.774127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:43:01.775338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:43:01.852873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 652/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:43:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:43:01.876316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b00ec-9f2e-4e27-8a2f-c2c779c27d5b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:02.004484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b00ec-9f2e-4e27-8a2f-c2c779c27d5b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:02.045835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:02.046654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:02.046938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:02.047212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:02.047869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:02.049314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:43:02.061906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:43:02.062972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:02.064358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 646/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:43:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:43:02.072478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:02.096549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:02.186221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39afec6-d5e7-4430-9f18-b8ffb83aa8f0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:02.221889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:02.222541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:02.222825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:02.223096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:02.223799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] RBAC: Adding query filter params (name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:43:02.224105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:02.225496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:02.230619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 653/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jun 20 14:43:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:43:02.240148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:02.276167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:02.362940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1eeda0-7cb4-4fce-9837-dafc298b96e8 None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:02.398390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:02.399083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:02.399358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:02.399633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:02.400416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] RBAC: Adding query filter params (interface=public, service_id=32dce77fe251428b8f91d27460d84ee6, region_id=RegionOne) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:43:02.400764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:02.402130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cbd23-b4d1-41eb-b74c-565a37f9caf8 None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:02.407293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 647/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Mon Jun 20 14:43:02 2022] GET /identity/v3/endpoints?service_id=32dce77fe251428b8f91d27460d84ee6&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:43:02.415949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:02.502953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:02.525623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75141-d297-4f98-aeb7-c465a22feefd None admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:02.562398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:02.562987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:02.563268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:02.563543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:02.564221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:02.565943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06793ef2-6c5f-4602-b4bd-ce12949ddb98 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:02.572926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 654/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Mon Jun 20 14:43:02 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:43:04.562206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5226e-1152-4773-82c2-c4f3f324a744 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:04.562760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5226e-1152-4773-82c2-c4f3f324a744 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:04.562760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5226e-1152-4773-82c2-c4f3f324a744 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:04.564941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 648/1302] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:43:04.573557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:04.573974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:04.574175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:04.601839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:43:04.603158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:43:04.690723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 655/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:43:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 20 14:43:04.713902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5226e-1152-4773-82c2-c4f3f324a744 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:04.836400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:04.843680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5226e-1152-4773-82c2-c4f3f324a744 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:04.882234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:04.883112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:04.883399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:04.883668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] PATH_INFO: `/v3/services/placement` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:04.884324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:04.885754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 20 14:43:04.898509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 20 14:43:04.899638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.get_or_create( Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application with Lock( Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self._enter() Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application return self.creator() Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application created_value = creator( Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: ERROR keystone.server.flask.application Jun 20 14:43:04.900632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 649/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Mon Jun 20 14:43:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 20 14:43:04.906055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:04.993588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:05.020153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9a881-ad87-4ed8-8c52-41453c0ae179 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:05.056563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:05.057592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:05.058037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:05.058442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] PATH_INFO: `/v3/services` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:05.059539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:43:05.060008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:05.062211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08474f0-cedf-49c8-b1bd-1668de0599f5 None admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:05.069734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 656/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Mon Jun 20 14:43:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:43:05.076326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:43:05.190849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3666f-b60c-45c4-a5d9-49b21b47222d None admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:43:05.229398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:43:05.230369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:43:05.230792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:43:05.231210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:43:05.232403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:43:05.234681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f35cf-4df1-476e-92c7-53e4abe4ec7b None admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:43:05.258873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 650/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Mon Jun 20 14:43:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:43:15.066023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=30 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:43:15.254200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:07.966632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5851c-752f-4472-ad74-46dd6dfd0a93 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:07.967196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5851c-752f-4472-ad74-46dd6dfd0a93 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:07.967196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5851c-752f-4472-ad74-46dd6dfd0a93 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:07.973675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752931fc-f378-49ba-a139-f6b5b909920a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:07.974117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752931fc-f378-49ba-a139-f6b5b909920a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:07.974223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752931fc-f378-49ba-a139-f6b5b909920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:07.977022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 657/1307] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:07 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:08.056978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-752931fc-f378-49ba-a139-f6b5b909920a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:08.058365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-752931fc-f378-49ba-a139-f6b5b909920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:08.162613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 651/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:44:08.236479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:08.236782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:08.237056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:08.238441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 658/1309] 10.222.0.23 () {54 vars in 964 bytes} [Mon Jun 20 14:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:08.253405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213efde0-2468-45b0-acf1-706ff028911b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:08.253696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213efde0-2468-45b0-acf1-706ff028911b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:08.254047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213efde0-2468-45b0-acf1-706ff028911b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:08.402534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-213efde0-2468-45b0-acf1-706ff028911b None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:08.403717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-213efde0-2468-45b0-acf1-706ff028911b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:08.436973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:08.529356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 652/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Jun 20 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:08.542699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:08.545181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:08.691959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaf2bd-d256-47ff-94f7-56b4f4b9e6d1 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:08.782364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:08.782935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:08.783261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:08.783565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:08.785246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:08.843563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:08.915789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:08.917366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684c5a4-9a2b-4102-881a-415cf3532b58 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:08.941869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 659/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:11.237927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:11.238484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:11.238484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:11.239898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 653/1312] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:11.245274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd5f6-93fc-4dde-bf61-fb5dfe16e5f8 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:11.245708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd5f6-93fc-4dde-bf61-fb5dfe16e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:11.245949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebd5f6-93fc-4dde-bf61-fb5dfe16e5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:11.327044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-65ebd5f6-93fc-4dde-bf61-fb5dfe16e5f8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:11.328173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-65ebd5f6-93fc-4dde-bf61-fb5dfe16e5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:11.427434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 660/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:11.466437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:11.468005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:11.583949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927e095-fe48-4e59-8639-f754a2368996 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:11.659383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:11.665067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:11.665730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:11.666245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:11.666520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:11.668218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:11.779921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:11.781459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2fce-4afc-4c0e-be6c-6d0ab3da5e51 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:11.800704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 654/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:14.143880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e354b2-1f61-46e8-a975-8f6cde306d4a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:14.144689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e354b2-1f61-46e8-a975-8f6cde306d4a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:14.144689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e354b2-1f61-46e8-a975-8f6cde306d4a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:14.146820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 661/1315] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:14.155480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a5d3-6c15-49ff-adbe-fffd510a7d13 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:14.155896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a5d3-6c15-49ff-adbe-fffd510a7d13 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:14.156054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254a5d3-6c15-49ff-adbe-fffd510a7d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:14.230641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e254a5d3-6c15-49ff-adbe-fffd510a7d13 None None] MFA Rules not processed for user `b6591b35cbee414c9fc297e019619805`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:14.231866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e254a5d3-6c15-49ff-adbe-fffd510a7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:14.298373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:14.352757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 655/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:14.413163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:14.413376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:14.413625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:14.415027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 662/1317] 10.222.0.23 () {54 vars in 964 bytes} [Mon Jun 20 14:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:14.424084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d976f-2eff-4b6b-885d-e22fcd7994df None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:14.424536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d976f-2eff-4b6b-885d-e22fcd7994df None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:14.425011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d976f-2eff-4b6b-885d-e22fcd7994df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:14.509513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9f0d976f-2eff-4b6b-885d-e22fcd7994df None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:14.510989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9f0d976f-2eff-4b6b-885d-e22fcd7994df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:14.589358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 656/1318] 10.222.0.23 () {58 vars in 1061 bytes} [Mon Jun 20 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:14.598904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:14.602289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:14.618105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:14.723081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd136175-0f06-44ee-b5ef-02872d8b3a6e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:14.803509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:14.804449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:14.804758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:14.805024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:14.806741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:14.875130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:14.926402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:14.927908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181e80c-5a00-4acb-952e-6610f7af6761 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:14.950071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 663/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:17.887216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:17.887788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:17.887901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:17.889341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 657/1320] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:17.895076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8769-b969-412c-b5c7-13b06e342252 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:17.895497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8769-b969-412c-b5c7-13b06e342252 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:17.895633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a8769-b969-412c-b5c7-13b06e342252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:17.963807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e13a8769-b969-412c-b5c7-13b06e342252 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:17.965066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e13a8769-b969-412c-b5c7-13b06e342252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:18.085926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 664/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:18.127812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:18.129406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:18.193248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:18.261410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7a49-0877-475b-8bad-b0e144431e74 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:18.334947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:18.335592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:18.335870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:18.336143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:18.337824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:18.436363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:18.459431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:18.460940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f8510-c4bd-4e1c-aa8d-b6b195fcd18c service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:18.480330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 658/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:44:21.193314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:21.193892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:21.193892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:21.195265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 665/1323] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:21.200991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9c81-20b9-4008-a84e-4afb9a6b74a1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:21.201438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9c81-20b9-4008-a84e-4afb9a6b74a1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:21.201541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba9c81-20b9-4008-a84e-4afb9a6b74a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:21.272808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8cba9c81-20b9-4008-a84e-4afb9a6b74a1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:21.274022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8cba9c81-20b9-4008-a84e-4afb9a6b74a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:21.381032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 659/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:21.417057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:21.418757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:21.440234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:21.531110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70e081-b947-4ee4-bee7-2d4f36ceedfa None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:21.606421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:21.607065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:21.607345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:21.607616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:21.609265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:21.683680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:21.725008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:21.726530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c04a2e-601c-4730-87fd-dfff265e5629 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:21.748190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 666/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:23.808812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:23.809355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:23.809355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:23.810786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 660/1326] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:23.816171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1ad1-9f68-4b9e-9a32-94d34a8ad86d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:23.816700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1ad1-9f68-4b9e-9a32-94d34a8ad86d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:23.816700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a1ad1-9f68-4b9e-9a32-94d34a8ad86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:23.886186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-550a1ad1-9f68-4b9e-9a32-94d34a8ad86d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:23.887447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-550a1ad1-9f68-4b9e-9a32-94d34a8ad86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:23.987888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 667/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:24.024256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:24.025836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:24.090349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:24.136965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870908ca-bf59-4582-823a-8fea1cc5a775 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:24.227759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:24.228435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:24.228765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:24.228993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:24.230845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:24.344995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:24.348029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:24.350513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64133ed0-9965-42d8-a2e5-d58453d1a956 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:24.369256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 661/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:26.433121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:26.433649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:26.433649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:26.435052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 668/1329] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:26.440895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398b17-daae-4c88-8ab4-2042b73551b6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:26.441344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398b17-daae-4c88-8ab4-2042b73551b6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:26.441457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22398b17-daae-4c88-8ab4-2042b73551b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:26.509799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-22398b17-daae-4c88-8ab4-2042b73551b6 None None] MFA Rules not processed for user `b6591b35cbee414c9fc297e019619805`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:26.511059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-22398b17-daae-4c88-8ab4-2042b73551b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:26.615765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 662/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:26.653100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:26.654666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:26.686044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:26.766050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb57948-9ec4-4d82-88e1-b905c5caecd0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:26.845799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:26.846474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:26.846736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:26.847005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:26.848760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:26.929773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:26.978922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:26.980359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16118575-6028-4ec6-b4b7-b8559603c34f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:27.001925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 669/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:29.265957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:29.266859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:29.266859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:29.269074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 663/1332] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:29.275340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20a6f-e81d-4be1-9d45-faebc73ba030 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:29.275846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20a6f-e81d-4be1-9d45-faebc73ba030 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:29.275949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f20a6f-e81d-4be1-9d45-faebc73ba030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:29.349703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-97f20a6f-e81d-4be1-9d45-faebc73ba030 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:29.350973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-97f20a6f-e81d-4be1-9d45-faebc73ba030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:29.463468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 670/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:29.503229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:29.504893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:29.591455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:29.631961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fdb6-c03f-43c2-9058-3f4e72bea9d4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:29.710265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:29.710907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:29.711189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:29.711458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:29.713122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:29.838835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:29.840302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b9dbf-0a73-4a18-b12e-b7bb509fc340 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:29.851886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:29.860788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 664/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:31.917565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:31.918085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:31.918085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:31.919477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 671/1335] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:31.925850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75fac8-b447-44d2-9d68-763174895fe5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:31.926617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75fac8-b447-44d2-9d68-763174895fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:31.926800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75fac8-b447-44d2-9d68-763174895fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:31.994310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5f75fac8-b447-44d2-9d68-763174895fe5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:31.995511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5f75fac8-b447-44d2-9d68-763174895fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:32.104418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 665/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:32.147136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:32.149630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:32.207161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:32.286057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afef2eb-294c-41d2-9d83-6d5fed7e46bd None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:32.370103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:32.370742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:32.371020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:32.371268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:32.372953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:32.463681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:32.491247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:32.492691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df02b6f-a955-4705-8e26-4d660aaf10bc service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:32.511012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 672/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:34.880665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:34.881270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:34.881270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:34.882656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 666/1338] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:34.889093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe3c0-5428-4bc2-b5a1-779bdf7a0624 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:34.889811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe3c0-5428-4bc2-b5a1-779bdf7a0624 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:34.890027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fe3c0-5428-4bc2-b5a1-779bdf7a0624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:34.966886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f38fe3c0-5428-4bc2-b5a1-779bdf7a0624 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:34.968141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f38fe3c0-5428-4bc2-b5a1-779bdf7a0624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:35.078757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 673/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:35.115822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:35.117402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:35.212991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:35.243260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160f89d-b44f-49c1-8ef9-bd7d9870b28d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:35.323746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:35.324410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:35.324691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:35.325002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:35.326668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:35.451563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:35.453053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252bbf37-525b-4f20-9b7f-27f2279f16dd service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:35.471684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 667/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:39.407722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:39.408260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:39.408260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:39.409822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 674/1341] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:39.418163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076412-3b45-4c46-b326-24bafbf21bbb None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:39.418602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076412-3b45-4c46-b326-24bafbf21bbb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:39.418828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076412-3b45-4c46-b326-24bafbf21bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:39.425269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:39.495608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1e076412-3b45-4c46-b326-24bafbf21bbb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:39.496893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1e076412-3b45-4c46-b326-24bafbf21bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:39.613736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 668/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:39.653554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:39.656099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:39.707879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:39.756688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29fc26-97db-47c0-bd00-8cc21e5654f6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:39.760453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:39.761124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:39.761401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:39.761672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:39.771239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:39.772734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb323b16-5500-492b-ac84-64ada1546869 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:39.782917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 675/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:42.605333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924be9-55da-470e-8668-bad6021a91ac None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:42.605889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924be9-55da-470e-8668-bad6021a91ac None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:42.605889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924be9-55da-470e-8668-bad6021a91ac None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:42.607312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 669/1344] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:42.613101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c106d-de2d-48e5-b040-46c5fce20dba None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:42.614025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c106d-de2d-48e5-b040-46c5fce20dba None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:42.614025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c106d-de2d-48e5-b040-46c5fce20dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:42.643040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-891c106d-de2d-48e5-b040-46c5fce20dba None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:42.644295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-891c106d-de2d-48e5-b040-46c5fce20dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:42.736215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 676/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:42.773805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924be9-55da-470e-8668-bad6021a91ac None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:42.785054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924be9-55da-470e-8668-bad6021a91ac None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:42.789083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:42.789724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:42.789997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:42.790263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:42.799562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:42.801012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597cb61-ac34-4119-8ed6-d5e44a5105b7 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:42.810649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 670/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:44:47.055114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:47.055643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:47.055922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:47.057446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 677/1347] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:47.062707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a70ee8-7c07-4ce1-92b2-ad2bc21bf08d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:47.063180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a70ee8-7c07-4ce1-92b2-ad2bc21bf08d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:47.063272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a70ee8-7c07-4ce1-92b2-ad2bc21bf08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:47.081469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a7a70ee8-7c07-4ce1-92b2-ad2bc21bf08d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:47.082764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a7a70ee8-7c07-4ce1-92b2-ad2bc21bf08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:47.091171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 671/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:47.129826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:44:47.131919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:47.147920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867c57-b6be-4a92-b754-6f4b7b87cae7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:44:47.151575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:44:47.152222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:47.152508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:47.152776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:47.162507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:44:47.164690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351b91c-ab72-4bb3-a2e2-7bd4799fb562 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:44:47.176687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 678/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:44:52.041222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7893-f46e-4953-883e-6a87b3eb991c None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:52.041727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7893-f46e-4953-883e-6a87b3eb991c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:52.041821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd7893-f46e-4953-883e-6a87b3eb991c None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:52.043192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 672/1350] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:52.048557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1171-7489-4c78-b7ad-082495bab6f2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:52.049041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1171-7489-4c78-b7ad-082495bab6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:52.049336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1171-7489-4c78-b7ad-082495bab6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:52.180526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f0eb1171-7489-4c78-b7ad-082495bab6f2 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:52.182045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f0eb1171-7489-4c78-b7ad-082495bab6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:52.215966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:52.284941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 679/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:44:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:56.518546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14fcf-d5bd-4971-b248-ac492fd12ed4 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:56.519106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14fcf-d5bd-4971-b248-ac492fd12ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:56.519650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba14fcf-d5bd-4971-b248-ac492fd12ed4 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:56.522592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 673/1352] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:44:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:56.528274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b895-ba97-41bd-8d6c-80ef78bea935 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:56.528810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b895-ba97-41bd-8d6c-80ef78bea935 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:56.529076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9b895-ba97-41bd-8d6c-80ef78bea935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:56.549355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f4c9b895-ba97-41bd-8d6c-80ef78bea935 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:56.551201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f4c9b895-ba97-41bd-8d6c-80ef78bea935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:56.561254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 680/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:44:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:44:57.076508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=72 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:44:57.952958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0786-b227-4698-bd35-9cae006c5a30 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:57.953641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0786-b227-4698-bd35-9cae006c5a30 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:57.953641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd0786-b227-4698-bd35-9cae006c5a30 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:57.954910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 674/1354] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:44:57.960114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d7d7-783d-4f39-a689-b7fc8073ef1c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:44:57.960543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d7d7-783d-4f39-a689-b7fc8073ef1c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:44:57.960817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d7d7-783d-4f39-a689-b7fc8073ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:44:57.979638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1d37d7d7-783d-4f39-a689-b7fc8073ef1c None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:44:57.980926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1d37d7d7-783d-4f39-a689-b7fc8073ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:44:57.990542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 681/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:44:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:01.709577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606fd7-3d3c-4d34-ae7c-efc4a507e1c3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:01.710536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606fd7-3d3c-4d34-ae7c-efc4a507e1c3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:01.710924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606fd7-3d3c-4d34-ae7c-efc4a507e1c3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:01.712598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 675/1356] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:01.720426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909dec-7ab9-4af5-b317-7e5b8fe52b12 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:01.721046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909dec-7ab9-4af5-b317-7e5b8fe52b12 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:01.721214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4909dec-7ab9-4af5-b317-7e5b8fe52b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:01.742631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b4909dec-7ab9-4af5-b317-7e5b8fe52b12 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:01.744202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b4909dec-7ab9-4af5-b317-7e5b8fe52b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:01.752878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 682/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:01.809529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f71-5538-4d3f-92b2-dd61e492b1c9 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:01.810014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f71-5538-4d3f-92b2-dd61e492b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:01.810441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c4f71-5538-4d3f-92b2-dd61e492b1c9 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:01.812323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 676/1358] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jun 20 14:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:01.820446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063370b-7fe7-4999-88fb-d5dc8a58e532 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:01.820979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063370b-7fe7-4999-88fb-d5dc8a58e532 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:01.821503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063370b-7fe7-4999-88fb-d5dc8a58e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:01.877534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4063370b-7fe7-4999-88fb-d5dc8a58e532 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:01.878926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4063370b-7fe7-4999-88fb-d5dc8a58e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:01.968443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 683/1359] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jun 20 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:45:01.976641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4f71-5538-4d3f-92b2-dd61e492b1c9 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:01.992652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c4f71-5538-4d3f-92b2-dd61e492b1c9 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:01.998289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:01.999055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:01.999435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:01.999810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:02.012392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:02.014462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee1fc4-b93f-4294-8f4f-c954883f633f service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:02.029850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 677/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:04.280239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab485d-956a-4eca-a288-51d9b5cf88ff None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:04.280808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab485d-956a-4eca-a288-51d9b5cf88ff None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:04.281116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab485d-956a-4eca-a288-51d9b5cf88ff None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:04.282750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 684/1361] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:04.288757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2e03-49d3-4866-b962-58f49111c001 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:04.289235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2e03-49d3-4866-b962-58f49111c001 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:04.289538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2e03-49d3-4866-b962-58f49111c001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:04.308302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-df1d2e03-49d3-4866-b962-58f49111c001 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:04.309703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-df1d2e03-49d3-4866-b962-58f49111c001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:04.318600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 678/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:04.362757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab485d-956a-4eca-a288-51d9b5cf88ff None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:04.378114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab485d-956a-4eca-a288-51d9b5cf88ff None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:04.383809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:04.384443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:04.385229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:04.385229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:04.393784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:04.395483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3982df-6379-43b3-b46c-4aa1bce21c1b service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:04.405432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 685/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:06.733404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba48d-45b7-4312-b35d-05364ca37153 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:06.735979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba48d-45b7-4312-b35d-05364ca37153 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:06.736537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ba48d-45b7-4312-b35d-05364ca37153 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:06.739144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 679/1364] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:06.746052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d33-6b80-4525-8b9c-c7f7ca92480f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:06.746553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d33-6b80-4525-8b9c-c7f7ca92480f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:06.746648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e7d33-6b80-4525-8b9c-c7f7ca92480f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:06.766239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f59e7d33-6b80-4525-8b9c-c7f7ca92480f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:06.767672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f59e7d33-6b80-4525-8b9c-c7f7ca92480f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:06.776614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 686/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:06.822997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad642-223a-4cf2-8fb0-df10d4eb9785 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:06.823359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad642-223a-4cf2-8fb0-df10d4eb9785 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:06.823640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad642-223a-4cf2-8fb0-df10d4eb9785 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:06.825148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 680/1366] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jun 20 14:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:06.830543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bdb7f-98e2-4d35-ba6d-19e05951119c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:06.830963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bdb7f-98e2-4d35-ba6d-19e05951119c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:06.831243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bdb7f-98e2-4d35-ba6d-19e05951119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:06.850246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c06bdb7f-98e2-4d35-ba6d-19e05951119c None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:06.851475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c06bdb7f-98e2-4d35-ba6d-19e05951119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:06.862039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 687/1367] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jun 20 14:45:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:45:06.870342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad642-223a-4cf2-8fb0-df10d4eb9785 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:06.888327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad642-223a-4cf2-8fb0-df10d4eb9785 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:06.894882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:06.895659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:06.895950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:06.896227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:06.904908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:06.906539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c9c86-61c4-461d-8eb5-865227399552 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:06.916996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 681/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:08.989191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676182-0c2c-4f6b-aba2-67f6ea82a5b7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:08.989760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676182-0c2c-4f6b-aba2-67f6ea82a5b7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:08.989760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d676182-0c2c-4f6b-aba2-67f6ea82a5b7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:08.991198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 688/1369] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:08.996649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8bfa9-725b-429c-bf30-633a146e75d3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:08.997113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8bfa9-725b-429c-bf30-633a146e75d3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:08.997296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8bfa9-725b-429c-bf30-633a146e75d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:09.016395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-50d8bfa9-725b-429c-bf30-633a146e75d3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:09.017772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-50d8bfa9-725b-429c-bf30-633a146e75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:09.036948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 682/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:09.076678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676182-0c2c-4f6b-aba2-67f6ea82a5b7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:09.092463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d676182-0c2c-4f6b-aba2-67f6ea82a5b7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:09.098779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:09.099540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:09.099925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:09.100299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:09.109784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:09.111532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e1c1b-7408-45ec-b48a-99f8469b6bf1 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:09.122880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 689/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:09.801057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993123-13dc-4ca3-8400-0651bdfdb1bb None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:09.801319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993123-13dc-4ca3-8400-0651bdfdb1bb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:09.801582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85993123-13dc-4ca3-8400-0651bdfdb1bb None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:09.803167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 683/1372] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:09.808574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ad67-5a79-474e-a675-0dec893d3550 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:09.808902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ad67-5a79-474e-a675-0dec893d3550 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:09.809165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24ad67-5a79-474e-a675-0dec893d3550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:09.828374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7c24ad67-5a79-474e-a675-0dec893d3550 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:09.829804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7c24ad67-5a79-474e-a675-0dec893d3550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:09.844756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 690/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:10.177601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058a83-d2d9-4800-9d79-09a664b487c1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:10.178159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058a83-d2d9-4800-9d79-09a664b487c1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:10.178297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23058a83-d2d9-4800-9d79-09a664b487c1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:10.179975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 684/1374] 10.222.0.23 () {54 vars in 963 bytes} [Mon Jun 20 14:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:10.185164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2c92-71a3-4439-badc-2a71699944cb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:10.185633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2c92-71a3-4439-badc-2a71699944cb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:10.185909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2c92-71a3-4439-badc-2a71699944cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:10.194063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:10.244124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-226f2c92-71a3-4439-badc-2a71699944cb None None] MFA Rules not processed for user `4e17921df6504f73b8a743b477924590`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:10.245366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-226f2c92-71a3-4439-badc-2a71699944cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:10.321067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 691/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Jun 20 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:10.329155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058a83-d2d9-4800-9d79-09a664b487c1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:10.340398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23058a83-d2d9-4800-9d79-09a664b487c1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:10.343887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:10.344529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:10.344845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:10.345116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:10.355740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:10.357228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f3ba0d-71be-495f-ba3c-6e4a87727b2e service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:10.367438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 685/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:11.208543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ae-fc08-493f-890e-5b286e897d90 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:11.209119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ae-fc08-493f-890e-5b286e897d90 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:11.209212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898163ae-fc08-493f-890e-5b286e897d90 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:11.210616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 692/1377] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:11.216186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0995cf-56ef-4d00-999e-b0e500819b72 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:11.216570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0995cf-56ef-4d00-999e-b0e500819b72 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:11.216884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0995cf-56ef-4d00-999e-b0e500819b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:11.234857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-fc0995cf-56ef-4d00-999e-b0e500819b72 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:11.236146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fc0995cf-56ef-4d00-999e-b0e500819b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:11.245460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 686/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:11.290103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898163ae-fc08-493f-890e-5b286e897d90 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:11.305220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898163ae-fc08-493f-890e-5b286e897d90 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:11.312319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:11.312987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:11.313277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:11.313878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:11.322452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:11.324045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44704d1-807a-473c-8dac-172bf65d2caa service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:11.334048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 693/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:13.379551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b88f-f8d7-487f-a6b3-680db19127bb None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:13.380439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b88f-f8d7-487f-a6b3-680db19127bb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:13.380752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7b88f-f8d7-487f-a6b3-680db19127bb None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:13.386676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 687/1380] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:13.387424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87853db-021d-484e-ba9f-adece5ad77ae None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:13.387904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87853db-021d-484e-ba9f-adece5ad77ae None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:13.388082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87853db-021d-484e-ba9f-adece5ad77ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:13.407207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a87853db-021d-484e-ba9f-adece5ad77ae None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:13.408401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a87853db-021d-484e-ba9f-adece5ad77ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:13.416367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 694/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:13.460036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b88f-f8d7-487f-a6b3-680db19127bb None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:13.474368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7b88f-f8d7-487f-a6b3-680db19127bb None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:13.479831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:13.480467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:13.480780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:13.481053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:13.489581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:13.491186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee1772-9efd-477d-a7b9-97c78550ade5 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:13.500459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 688/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:15.568762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8582-f782-46ca-b491-75f99b687586 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:15.569690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8582-f782-46ca-b491-75f99b687586 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:15.569973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b8582-f782-46ca-b491-75f99b687586 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:15.571403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 695/1383] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:15.577116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545540-2a49-4ee2-8921-4592a87da69a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:15.577645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545540-2a49-4ee2-8921-4592a87da69a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:15.577955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545540-2a49-4ee2-8921-4592a87da69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:15.596371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5a545540-2a49-4ee2-8921-4592a87da69a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:15.597795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5a545540-2a49-4ee2-8921-4592a87da69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:15.606216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 689/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:15.649193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b8582-f782-46ca-b491-75f99b687586 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:15.665313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b8582-f782-46ca-b491-75f99b687586 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:15.670904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:15.671918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:15.672301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:15.672673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:15.681776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:15.683477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03721cc7-3410-4cda-9272-1aab2d9eb367 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:15.694448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 696/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:17.748898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270042-4b89-4ffb-8c22-b9542f6b1945 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:17.749392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270042-4b89-4ffb-8c22-b9542f6b1945 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:17.749392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd270042-4b89-4ffb-8c22-b9542f6b1945 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:17.751102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 690/1386] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:17.757378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ba20-1ab5-45da-ade6-ee1b5ce3ef6c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:17.758191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ba20-1ab5-45da-ade6-ee1b5ce3ef6c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:17.758191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58ba20-1ab5-45da-ade6-ee1b5ce3ef6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:17.782507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3b58ba20-1ab5-45da-ade6-ee1b5ce3ef6c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:17.783668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3b58ba20-1ab5-45da-ade6-ee1b5ce3ef6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:17.792229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 697/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:17.836240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd270042-4b89-4ffb-8c22-b9542f6b1945 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:17.850778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd270042-4b89-4ffb-8c22-b9542f6b1945 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:17.856278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:17.856949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:17.857231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:17.857502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:17.866343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:17.867966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201bfa2-140f-4d74-bcf3-0b889583344e service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:17.879079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 691/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:20.131448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f6f2-846f-47de-924a-25308c21b1e7 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:20.132078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f6f2-846f-47de-924a-25308c21b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:20.132565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933f6f2-846f-47de-924a-25308c21b1e7 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:20.135428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 698/1389] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:20.144945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63110-ed7d-4db8-b092-8a4c7170ec4e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:20.145456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63110-ed7d-4db8-b092-8a4c7170ec4e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:20.145556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63110-ed7d-4db8-b092-8a4c7170ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:20.167269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b5d63110-ed7d-4db8-b092-8a4c7170ec4e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:20.169023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b5d63110-ed7d-4db8-b092-8a4c7170ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:20.180456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 692/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:20.237478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933f6f2-846f-47de-924a-25308c21b1e7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:20.253447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933f6f2-846f-47de-924a-25308c21b1e7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:20.259818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:20.260678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:20.261054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:20.261392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:20.271884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:20.273717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646e790-3626-4406-9a96-00cf85b0e61e service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:20.285093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 699/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:22.373004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d845-b02f-4ac1-97b2-b076916934d6 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:22.373708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d845-b02f-4ac1-97b2-b076916934d6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:22.373708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7d845-b02f-4ac1-97b2-b076916934d6 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:22.374903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 693/1392] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:22.382196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ac4d-e036-404c-a0cc-33c7be7af74f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:22.382813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ac4d-e036-404c-a0cc-33c7be7af74f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:22.382813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ac4d-e036-404c-a0cc-33c7be7af74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:22.402227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9f53ac4d-e036-404c-a0cc-33c7be7af74f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:22.403470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9f53ac4d-e036-404c-a0cc-33c7be7af74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:22.412472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 700/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:22.456756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7d845-b02f-4ac1-97b2-b076916934d6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:22.471700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7d845-b02f-4ac1-97b2-b076916934d6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:22.477435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:22.478331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:22.478574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:22.478849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:22.487658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:22.489414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cc3ce-5747-42a5-8ea9-36d2a121948c service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:22.499465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 694/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:24.681738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4b5f-3e4e-43df-997c-dc3335e634e9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:24.682359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4b5f-3e4e-43df-997c-dc3335e634e9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:24.682359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a4b5f-3e4e-43df-997c-dc3335e634e9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:24.683704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 701/1395] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:24.689638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690702a7-46df-4481-ae68-c21dffcc1a37 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:24.690082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690702a7-46df-4481-ae68-c21dffcc1a37 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:24.690453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690702a7-46df-4481-ae68-c21dffcc1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:24.709638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-690702a7-46df-4481-ae68-c21dffcc1a37 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:24.710851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-690702a7-46df-4481-ae68-c21dffcc1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:24.719626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 695/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:24.764311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a4b5f-3e4e-43df-997c-dc3335e634e9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:24.780034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a4b5f-3e4e-43df-997c-dc3335e634e9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:24.786594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:24.787237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:24.787513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:24.787784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:24.796550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:24.798231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5a960-e6ef-4949-a38d-12d49e591f49 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:24.808558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 702/1397] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:25.342239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830647f-aa65-4461-9869-f370fe4626de None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:25.342483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830647f-aa65-4461-9869-f370fe4626de None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:25.342689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830647f-aa65-4461-9869-f370fe4626de None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:25.344109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 696/1398] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:25.349613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a3fb-d63a-4b4d-93d0-804bce686f1b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:25.349905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a3fb-d63a-4b4d-93d0-804bce686f1b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:25.350184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3a3fb-d63a-4b4d-93d0-804bce686f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:25.370425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3fd3a3fb-d63a-4b4d-93d0-804bce686f1b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:25.371652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3fd3a3fb-d63a-4b4d-93d0-804bce686f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:25.381197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 703/1399] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:25.439244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199613-2207-4313-8d1b-af5698cc4fd0 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:25.439539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199613-2207-4313-8d1b-af5698cc4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:25.439797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de199613-2207-4313-8d1b-af5698cc4fd0 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:25.441287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 697/1400] 10.222.0.23 () {54 vars in 962 bytes} [Mon Jun 20 14:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:25.446565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80dc5-04b3-406f-88c5-91471a839107 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:25.446858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80dc5-04b3-406f-88c5-91471a839107 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:25.447135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c80dc5-04b3-406f-88c5-91471a839107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:25.499151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-16c80dc5-04b3-406f-88c5-91471a839107 None None] MFA Rules not processed for user `aec0cfd566b94d8798716eb95fa75a60`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:25.500347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-16c80dc5-04b3-406f-88c5-91471a839107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:25.533857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:25.565065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 704/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Jun 20 14:45:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:25.573442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de199613-2207-4313-8d1b-af5698cc4fd0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:25.585399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de199613-2207-4313-8d1b-af5698cc4fd0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:25.589666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:25.590312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:25.590596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:25.590869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:25.600684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:25.602130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d572f32-43b9-46c2-803c-14a1c289b2b3 service glance] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:25.611899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 698/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:26.328791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bed4c-2e97-4237-af8c-2717d46b8a83 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.329289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bed4c-2e97-4237-af8c-2717d46b8a83 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.329289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18bed4c-2e97-4237-af8c-2717d46b8a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.379386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c18bed4c-2e97-4237-af8c-2717d46b8a83 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:26.380597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c18bed4c-2e97-4237-af8c-2717d46b8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:26.445792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 705/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:26.486041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da09f-32ba-4db2-b3b0-ca891dbb0ce1 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.486557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da09f-32ba-4db2-b3b0-ca891dbb0ce1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.486665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315da09f-32ba-4db2-b3b0-ca891dbb0ce1 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.488226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 699/1404] 10.222.0.23 () {54 vars in 942 bytes} [Mon Jun 20 14:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:26.494555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ac6a-d8f0-483a-ac93-4145395208a4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.494917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ac6a-d8f0-483a-ac93-4145395208a4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.495253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832ac6a-d8f0-483a-ac93-4145395208a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.544652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f832ac6a-d8f0-483a-ac93-4145395208a4 None None] MFA Rules not processed for user `b96d8006e32d48379aba33d842b0f000`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:26.545782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f832ac6a-d8f0-483a-ac93-4145395208a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:26.621206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 706/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Mon Jun 20 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:26.630792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da09f-32ba-4db2-b3b0-ca891dbb0ce1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:26.645638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315da09f-32ba-4db2-b3b0-ca891dbb0ce1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:26.651067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:26.651713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.652002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.652280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.661249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:26.662864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc65db5-9937-49f0-b834-1f08e11b9256 service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:26.671194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 700/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:45:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:45:26.856356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7996a-6bbd-4150-922c-37dda0202c55 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.856559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7996a-6bbd-4150-922c-37dda0202c55 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.856880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7996a-6bbd-4150-922c-37dda0202c55 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.860755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 707/1407] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:26.863776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7ffd-6143-472c-8a29-69d37af951d9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.864090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7ffd-6143-472c-8a29-69d37af951d9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.864354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f7ffd-6143-472c-8a29-69d37af951d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.882508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-186f7ffd-6143-472c-8a29-69d37af951d9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:26.883738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-186f7ffd-6143-472c-8a29-69d37af951d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:26.892143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 701/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:26.936913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7996a-6bbd-4150-922c-37dda0202c55 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:26.956566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7996a-6bbd-4150-922c-37dda0202c55 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:26.962352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:26.963189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:26.963631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:26.963906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:26.973486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:26.975068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db73e3e-3935-42f4-bd85-6445092da6e2 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:26.980534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:26.986094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 708/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:36.877147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=69 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:45:48.772980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12db9c-e2d8-4c6b-82a6-3f13db32bf43 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:48.773701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12db9c-e2d8-4c6b-82a6-3f13db32bf43 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:48.773701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12db9c-e2d8-4c6b-82a6-3f13db32bf43 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:48.775048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 702/1410] 10.222.0.23 () {54 vars in 918 bytes} [Mon Jun 20 14:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:48.780481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548db1-1d56-446e-bc2b-c796bd81cd03 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:48.781057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548db1-1d56-446e-bc2b-c796bd81cd03 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:48.781057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49548db1-1d56-446e-bc2b-c796bd81cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:48.799720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-49548db1-1d56-446e-bc2b-c796bd81cd03 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:48.800953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-49548db1-1d56-446e-bc2b-c796bd81cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:48.810074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 709/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Jun 20 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:48.825515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77c85-a9b0-4006-ba2e-c5c19bd682ce None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:48.825887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77c85-a9b0-4006-ba2e-c5c19bd682ce None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:48.826255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77c85-a9b0-4006-ba2e-c5c19bd682ce None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:48.828471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 703/1412] 10.222.0.23 () {54 vars in 918 bytes} [Mon Jun 20 14:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:48.833020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddce2-6a7d-4823-80c4-5e4ca2207961 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:48.833296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddce2-6a7d-4823-80c4-5e4ca2207961 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:48.833584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccddce2-6a7d-4823-80c4-5e4ca2207961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:48.851595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4ccddce2-6a7d-4823-80c4-5e4ca2207961 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:48.852776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4ccddce2-6a7d-4823-80c4-5e4ca2207961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:48.862479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 710/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Mon Jun 20 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:51.348816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679c59-7057-4e71-b6a3-7da05710a51a None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:51.349368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679c59-7057-4e71-b6a3-7da05710a51a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:51.349368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c679c59-7057-4e71-b6a3-7da05710a51a None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:51.350679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:51.356177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2d36-9827-4d9e-b7a4-34c7473bc03f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:51.356622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2d36-9827-4d9e-b7a4-34c7473bc03f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:51.356748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b2d36-9827-4d9e-b7a4-34c7473bc03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:51.376915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c31b2d36-9827-4d9e-b7a4-34c7473bc03f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:51.378696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c31b2d36-9827-4d9e-b7a4-34c7473bc03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:51.388333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:51.435574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c679c59-7057-4e71-b6a3-7da05710a51a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:51.456166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c679c59-7057-4e71-b6a3-7da05710a51a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:51.462911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:51.463592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:51.463871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:51.464145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:51.473454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:51.475063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9b1f0-33b6-4fa1-83e2-fcdb18408a84 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:51.484854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 705/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:52.374590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b656-19bc-4c30-b92e-3d40d3ca8284 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:52.375191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b656-19bc-4c30-b92e-3d40d3ca8284 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:52.375191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511b656-19bc-4c30-b92e-3d40d3ca8284 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:52.376513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:52.382448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6d7f-bb39-4c51-b662-2367ccf3767e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:52.383171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6d7f-bb39-4c51-b662-2367ccf3767e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:52.383277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae6d7f-bb39-4c51-b662-2367ccf3767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:52.407367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3aae6d7f-bb39-4c51-b662-2367ccf3767e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:52.408589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3aae6d7f-bb39-4c51-b662-2367ccf3767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:52.418221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:52.575991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511b656-19bc-4c30-b92e-3d40d3ca8284 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:52.594954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511b656-19bc-4c30-b92e-3d40d3ca8284 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:52.601248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:52.601877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:52.602163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:52.602439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:52.610899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:52.612524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e80b-9429-4a87-9cde-1530446f740b service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:52.622243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 713/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:53.500359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e3de-4a9a-412f-a877-d0b81a7d9191 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:53.500992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e3de-4a9a-412f-a877-d0b81a7d9191 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:53.500992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e3de-4a9a-412f-a877-d0b81a7d9191 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:53.502706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:53.507846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c657-23e9-410a-9fb1-2476472e0967 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:53.508303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c657-23e9-410a-9fb1-2476472e0967 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:53.508460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1c657-23e9-410a-9fb1-2476472e0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:53.532543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c0c1c657-23e9-410a-9fb1-2476472e0967 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:53.533887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c0c1c657-23e9-410a-9fb1-2476472e0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:53.543151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:53.693522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e3de-4a9a-412f-a877-d0b81a7d9191 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:53.713951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e3de-4a9a-412f-a877-d0b81a7d9191 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:53.720272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:53.720958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:53.721237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:53.721494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:53.729604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:53.731194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b29f7-fc0b-458b-9694-8c0004d6d96e service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:53.741000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 708/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:54.603679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7381-e07f-426e-9cdb-0d38f72c9b1e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:54.604604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7381-e07f-426e-9cdb-0d38f72c9b1e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:54.604604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf7381-e07f-426e-9cdb-0d38f72c9b1e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:54.606913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:54.614581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be7c-ec8c-4481-aaa9-037ddfe807eb None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:54.615014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be7c-ec8c-4481-aaa9-037ddfe807eb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:54.615165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384be7c-ec8c-4481-aaa9-037ddfe807eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:54.634795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4384be7c-ec8c-4481-aaa9-037ddfe807eb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:54.636016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4384be7c-ec8c-4481-aaa9-037ddfe807eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:54.645115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:54.797708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7381-e07f-426e-9cdb-0d38f72c9b1e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:54.820944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf7381-e07f-426e-9cdb-0d38f72c9b1e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:54.827515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:54.828151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:54.828427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:54.828693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:54.837372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:54.838952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa74535-b0ef-4730-938d-a5d940bdbb1d service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:54.848752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 716/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:55.709469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7654-a788-49ff-9662-4292043238e4 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:55.710087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7654-a788-49ff-9662-4292043238e4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:55.710087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b7654-a788-49ff-9662-4292043238e4 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:55.711396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:55.717469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a47b8-ba4b-414b-b29f-e8aba53edb86 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:55.717919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a47b8-ba4b-414b-b29f-e8aba53edb86 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:55.718035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a47b8-ba4b-414b-b29f-e8aba53edb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:55.746421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cc5a47b8-ba4b-414b-b29f-e8aba53edb86 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:55.748303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cc5a47b8-ba4b-414b-b29f-e8aba53edb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:55.758448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:55.920334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7654-a788-49ff-9662-4292043238e4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:55.939000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b7654-a788-49ff-9662-4292043238e4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:55.945758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:55.946388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:55.946665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:55.946973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:55.955918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:55.957549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67668df2-58c6-4e07-88be-80510d59a777 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:55.967275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 711/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:56.781012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad874e9-350b-4fd0-b6bc-0785ee632833 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:56.781613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad874e9-350b-4fd0-b6bc-0785ee632833 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:56.781613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad874e9-350b-4fd0-b6bc-0785ee632833 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:56.782936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:56.791499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb318-d5e3-4139-a111-7431bbf5de86 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:56.792255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb318-d5e3-4139-a111-7431bbf5de86 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:56.792413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfb318-d5e3-4139-a111-7431bbf5de86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:56.815066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ffcfb318-d5e3-4139-a111-7431bbf5de86 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:56.816304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ffcfb318-d5e3-4139-a111-7431bbf5de86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:56.825485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:56.984706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad874e9-350b-4fd0-b6bc-0785ee632833 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:57.006900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad874e9-350b-4fd0-b6bc-0785ee632833 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:57.013930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:57.014808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:57.015139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:57.015474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:57.025211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:57.026821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1068945-2bb2-487f-8aa1-1bf1b0dde4e5 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:57.038026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 719/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:57.828444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307cc4-d260-4a2c-b280-46e8459236dc None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:57.829410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307cc4-d260-4a2c-b280-46e8459236dc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:57.829410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76307cc4-d260-4a2c-b280-46e8459236dc None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:57.831516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:57.837312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5421-df55-4886-9b96-4d3efa687337 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:57.838044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5421-df55-4886-9b96-4d3efa687337 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:57.838229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed5421-df55-4886-9b96-4d3efa687337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:57.860049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-88ed5421-df55-4886-9b96-4d3efa687337 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:57.861428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-88ed5421-df55-4886-9b96-4d3efa687337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:57.872896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:58.034733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76307cc4-d260-4a2c-b280-46e8459236dc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:58.050916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76307cc4-d260-4a2c-b280-46e8459236dc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:58.057119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:58.057751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:58.058031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:58.058301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:58.067329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:58.068964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14c8b8-3410-43c5-ba0c-4250ab3afd05 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:58.079249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 714/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:58.880061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec9ad-12da-4c2e-9b82-8243f7226206 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:58.880636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec9ad-12da-4c2e-9b82-8243f7226206 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:58.880636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec9ad-12da-4c2e-9b82-8243f7226206 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:58.882018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:58.888372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06711d-f350-4af1-88ac-c3b9c4fb0d48 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:58.888847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06711d-f350-4af1-88ac-c3b9c4fb0d48 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:58.888961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06711d-f350-4af1-88ac-c3b9c4fb0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:58.909327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3e06711d-f350-4af1-88ac-c3b9c4fb0d48 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:58.910540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3e06711d-f350-4af1-88ac-c3b9c4fb0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:58.919411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:45:59.073695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec9ad-12da-4c2e-9b82-8243f7226206 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:45:59.090382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec9ad-12da-4c2e-9b82-8243f7226206 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:45:59.096541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:45:59.097201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:59.097487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:59.097760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:59.106298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:45:59.107866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a77edb-d585-4e80-96f7-574b59d26798 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:45:59.118023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 722/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:45:59.923126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6882-7990-4b31-9a1c-55c39257ec1b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:59.923938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6882-7990-4b31-9a1c-55c39257ec1b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:59.923938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6882-7990-4b31-9a1c-55c39257ec1b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:59.925977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:45:59.932575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9834e-65d2-4668-91c7-57f0aedbae0a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:45:59.933428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9834e-65d2-4668-91c7-57f0aedbae0a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:45:59.933610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9834e-65d2-4668-91c7-57f0aedbae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:45:59.961618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6da9834e-65d2-4668-91c7-57f0aedbae0a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:45:59.962838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6da9834e-65d2-4668-91c7-57f0aedbae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:45:59.973157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:00.127336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6882-7990-4b31-9a1c-55c39257ec1b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:00.144621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6882-7990-4b31-9a1c-55c39257ec1b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:00.151764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:00.152372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:00.152671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:00.152963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:00.161776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:00.163388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df6e45-93f9-4cb8-9477-13bbc7d99919 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:00.173653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 717/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:02.179331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64956-881c-4803-8d2a-79275fd17ee3 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:02.179911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64956-881c-4803-8d2a-79275fd17ee3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:02.179911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b64956-881c-4803-8d2a-79275fd17ee3 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:02.181353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:02.189143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643393-9d5d-4201-85bb-9c263152356c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:02.189612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643393-9d5d-4201-85bb-9c263152356c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:02.189777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b643393-9d5d-4201-85bb-9c263152356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:02.210331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2b643393-9d5d-4201-85bb-9c263152356c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:02.211555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2b643393-9d5d-4201-85bb-9c263152356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:02.220082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:46:02.262233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64956-881c-4803-8d2a-79275fd17ee3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:02.276885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b64956-881c-4803-8d2a-79275fd17ee3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:02.281624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:02.282297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:02.282579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:02.282857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:02.292364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:02.293851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d639c-4e92-4e48-a7c8-a210de15ffee service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:02.303856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 725/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:04.534339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe426f9-df33-4eb3-8734-d0caac5fd249 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:04.534976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe426f9-df33-4eb3-8734-d0caac5fd249 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:04.534976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe426f9-df33-4eb3-8734-d0caac5fd249 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:04.536291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:04.542740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24095-1ee9-4e2c-84f2-e7615fd01eb1 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:04.543436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24095-1ee9-4e2c-84f2-e7615fd01eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:04.543639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db24095-1ee9-4e2c-84f2-e7615fd01eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:04.571704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4db24095-1ee9-4e2c-84f2-e7615fd01eb1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:04.572952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4db24095-1ee9-4e2c-84f2-e7615fd01eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:04.582398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:04.622742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe426f9-df33-4eb3-8734-d0caac5fd249 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:04.634598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe426f9-df33-4eb3-8734-d0caac5fd249 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:04.638893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:04.639532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:04.639807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:04.640074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:04.650572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:04.652017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e105845-3b11-41c5-914d-efdea86a15f6 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:04.661809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 720/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:07.027499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a64e-3fe2-4e06-bc5e-1c406ceaa4ea None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:07.027950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a64e-3fe2-4e06-bc5e-1c406ceaa4ea None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:07.028042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004a64e-3fe2-4e06-bc5e-1c406ceaa4ea None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:07.029479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:07.035114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd82d-1b17-4907-a7a0-09e2abf419d1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:07.035551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd82d-1b17-4907-a7a0-09e2abf419d1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:07.035645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd82d-1b17-4907-a7a0-09e2abf419d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:07.054164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3bccd82d-1b17-4907-a7a0-09e2abf419d1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:07.055374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3bccd82d-1b17-4907-a7a0-09e2abf419d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:07.064258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:07.106497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a64e-3fe2-4e06-bc5e-1c406ceaa4ea None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:07.121131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004a64e-3fe2-4e06-bc5e-1c406ceaa4ea None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:07.128182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:07.128861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:07.129146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:07.129420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:07.139568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:07.141068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140d3c6-bdac-4a82-8c52-6b1bbb770414 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:07.151077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 728/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:46:09.282536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589457-fd0a-4208-b2a4-9103a79ff4af None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:09.283446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589457-fd0a-4208-b2a4-9103a79ff4af None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:09.283446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20589457-fd0a-4208-b2a4-9103a79ff4af None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:09.285463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:09.291653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0959e-f518-4e6b-8a6e-15e7b59aaf8a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:09.292111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0959e-f518-4e6b-8a6e-15e7b59aaf8a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:09.292206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe0959e-f518-4e6b-8a6e-15e7b59aaf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:09.315439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-efe0959e-f518-4e6b-8a6e-15e7b59aaf8a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:09.316685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-efe0959e-f518-4e6b-8a6e-15e7b59aaf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:09.327552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:09.365581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20589457-fd0a-4208-b2a4-9103a79ff4af None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:09.377239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20589457-fd0a-4208-b2a4-9103a79ff4af None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:09.380916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:09.381554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:09.381834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:09.382104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:09.391850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:09.393451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6615906-9666-43fa-abda-ab41ed036909 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:09.403393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 723/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:11.474100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6e6e-5096-4bbc-ae6a-39e565bed201 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:11.474697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6e6e-5096-4bbc-ae6a-39e565bed201 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:11.474697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a6e6e-5096-4bbc-ae6a-39e565bed201 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:11.476041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:11.482416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d18d-2547-4201-a040-1bae8b019ae9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:11.483150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d18d-2547-4201-a040-1bae8b019ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:11.483331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0583d18d-2547-4201-a040-1bae8b019ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:11.508991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0583d18d-2547-4201-a040-1bae8b019ae9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:11.510216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0583d18d-2547-4201-a040-1bae8b019ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:11.519872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:11.557958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a6e6e-5096-4bbc-ae6a-39e565bed201 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:11.572512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a6e6e-5096-4bbc-ae6a-39e565bed201 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:11.576893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:11.577530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:11.577811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:11.578079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:11.587840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:11.589311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680ef5a-4017-43cb-8dd7-cf68110b951a service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:11.599006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 731/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:13.718130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eba9-207b-4c31-952b-d6fd82de2e7c None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:13.719079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eba9-207b-4c31-952b-d6fd82de2e7c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:13.719079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0eba9-207b-4c31-952b-d6fd82de2e7c None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:13.721066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:13.726697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10021d-7ea8-457b-88ad-977942a4831a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:13.727116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10021d-7ea8-457b-88ad-977942a4831a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:13.727234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10021d-7ea8-457b-88ad-977942a4831a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:13.746455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cd10021d-7ea8-457b-88ad-977942a4831a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:13.747682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cd10021d-7ea8-457b-88ad-977942a4831a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:13.756263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:13.794219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0eba9-207b-4c31-952b-d6fd82de2e7c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:13.806502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0eba9-207b-4c31-952b-d6fd82de2e7c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:13.810550 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:13.811179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:13.811462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:13.811782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:13.822835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:13.824295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605649b-1584-418c-9a91-70e1a1ab438c service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:13.833994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 726/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:15.899278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae426bf-ba12-4a4e-bba5-10f1375e966e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:15.900182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae426bf-ba12-4a4e-bba5-10f1375e966e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:15.900182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae426bf-ba12-4a4e-bba5-10f1375e966e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:15.902241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:15.907734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce07b1-bacc-4709-9757-ad6debbc75d9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:15.908308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce07b1-bacc-4709-9757-ad6debbc75d9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:15.908421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce07b1-bacc-4709-9757-ad6debbc75d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:15.926694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6fce07b1-bacc-4709-9757-ad6debbc75d9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:15.927907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6fce07b1-bacc-4709-9757-ad6debbc75d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:15.936187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:15.974309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae426bf-ba12-4a4e-bba5-10f1375e966e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:15.994082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae426bf-ba12-4a4e-bba5-10f1375e966e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:16.001045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:16.002040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:16.002296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:16.002595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:16.013141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:16.014639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef391d-9dc6-4749-87c8-6dc948f94c0f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:16.024928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 734/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:18.091826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219495-d92d-4afe-b4a3-5fe6345b00d0 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:18.092395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219495-d92d-4afe-b4a3-5fe6345b00d0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:18.092395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219495-d92d-4afe-b4a3-5fe6345b00d0 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:18.093806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:18.099396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79455-be4c-4bf4-b9e3-b1ad412c0078 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:18.099853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79455-be4c-4bf4-b9e3-b1ad412c0078 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:18.099949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb79455-be4c-4bf4-b9e3-b1ad412c0078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:18.106396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=79 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:18.120008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6bb79455-be4c-4bf4-b9e3-b1ad412c0078 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:18.121224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6bb79455-be4c-4bf4-b9e3-b1ad412c0078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:18.129497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:18.167107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219495-d92d-4afe-b4a3-5fe6345b00d0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:18.173970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=73 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:18.181301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219495-d92d-4afe-b4a3-5fe6345b00d0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:18.185517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:18.186146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:18.186425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:18.186699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:18.196744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:18.198215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cf36e-9ce1-4755-aa44-6667e9a5db42 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:18.207996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 729/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:20.264146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d062e0-21a6-46e7-94c8-3c71821bdb5e None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:20.265007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d062e0-21a6-46e7-94c8-3c71821bdb5e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:20.265007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d062e0-21a6-46e7-94c8-3c71821bdb5e None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:20.266722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:20.274172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02abd6e-4c05-41df-8519-0275f561aa4f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:20.275075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02abd6e-4c05-41df-8519-0275f561aa4f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:20.275075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02abd6e-4c05-41df-8519-0275f561aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:20.297465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d02abd6e-4c05-41df-8519-0275f561aa4f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:20.298793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d02abd6e-4c05-41df-8519-0275f561aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:20.308019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:20.344784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d062e0-21a6-46e7-94c8-3c71821bdb5e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:20.362001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d062e0-21a6-46e7-94c8-3c71821bdb5e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:20.367757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:20.368628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:20.369015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:20.369372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:20.381530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:20.382959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853654-11fc-47bc-92fe-d7153b13c051 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:20.392527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 737/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:22.483378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4518b0-6516-4b94-b9ab-0a27c6fcfc96 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:22.483960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4518b0-6516-4b94-b9ab-0a27c6fcfc96 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:22.483960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4518b0-6516-4b94-b9ab-0a27c6fcfc96 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:22.485370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:22.491578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca419-1671-4f66-b635-f6e9318b85f9 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:22.492074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca419-1671-4f66-b635-f6e9318b85f9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:22.492179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ca419-1671-4f66-b635-f6e9318b85f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:22.514313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9e2ca419-1671-4f66-b635-f6e9318b85f9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:22.515524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9e2ca419-1671-4f66-b635-f6e9318b85f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:22.524175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:22.564573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4518b0-6516-4b94-b9ab-0a27c6fcfc96 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:22.577944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4518b0-6516-4b94-b9ab-0a27c6fcfc96 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:22.582622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:22.583556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:22.583947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:22.584325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:22.596899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:22.598361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0be208-dee2-425b-be67-379bd170a81d service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:22.608146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 732/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:32.508989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=11 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:32.603827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=14 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:46:42.365352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb657-93b5-4b09-826f-bcf10c6a7bef None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:42.366193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb657-93b5-4b09-826f-bcf10c6a7bef None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:42.366193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb657-93b5-4b09-826f-bcf10c6a7bef None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:42.368058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 739/1471] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:42.376169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc078-ed9b-42f3-b25f-77b810a7c812 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:42.376758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc078-ed9b-42f3-b25f-77b810a7c812 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:42.376964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dc078-ed9b-42f3-b25f-77b810a7c812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:42.394663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c27dc078-ed9b-42f3-b25f-77b810a7c812 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:42.395880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c27dc078-ed9b-42f3-b25f-77b810a7c812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:42.404313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 733/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:46:42.459905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97123a4-24c5-4a6b-8022-094b1dede57f None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:42.460192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97123a4-24c5-4a6b-8022-094b1dede57f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:42.460665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97123a4-24c5-4a6b-8022-094b1dede57f None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:42.462066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 740/1473] 10.222.0.23 () {54 vars in 962 bytes} [Mon Jun 20 14:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:42.467045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec89e9-7768-4fa9-9849-0edbf1672072 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:42.467321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec89e9-7768-4fa9-9849-0edbf1672072 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:42.467627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec89e9-7768-4fa9-9849-0edbf1672072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:42.486803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-feec89e9-7768-4fa9-9849-0edbf1672072 None None] MFA Rules not processed for user `aec0cfd566b94d8798716eb95fa75a60`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:42.488009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-feec89e9-7768-4fa9-9849-0edbf1672072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:42.494929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 734/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Mon Jun 20 14:46:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:42.502604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97123a4-24c5-4a6b-8022-094b1dede57f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:42.513832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97123a4-24c5-4a6b-8022-094b1dede57f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:42.518011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:42.518641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:42.518916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:42.519194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:42.529813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:42.531833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b6aa0-bb54-4ff9-a51a-edda5d6ee95b service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:42.544739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 741/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:44.655587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307778-e406-4632-941a-d1a428e7be9f None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:44.656505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307778-e406-4632-941a-d1a428e7be9f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:44.656505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9307778-e406-4632-941a-d1a428e7be9f None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:44.658907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 735/1476] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:44.664270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31575a2c-dcb9-4a9f-bdc7-ce6c3d0b0790 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:44.664733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31575a2c-dcb9-4a9f-bdc7-ce6c3d0b0790 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:44.664849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31575a2c-dcb9-4a9f-bdc7-ce6c3d0b0790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:44.684526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-31575a2c-dcb9-4a9f-bdc7-ce6c3d0b0790 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:44.685763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-31575a2c-dcb9-4a9f-bdc7-ce6c3d0b0790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:44.695068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 742/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:44.719092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9307778-e406-4632-941a-d1a428e7be9f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:44.738565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9307778-e406-4632-941a-d1a428e7be9f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:44.744662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:44.745409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:44.745685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:44.745954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:44.746694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:44.748492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:46:44.748492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:46:44.748492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:46:44.749695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa6a61-09bf-42f8-ae02-d1e2b8deb0d7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:44.769453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 736/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Mon Jun 20 14:46:44 2022] GET /identity/v3/projects => generated 2553 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:46:46.807011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57926-71f6-4824-97df-ebdf055127e9 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:46.807885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57926-71f6-4824-97df-ebdf055127e9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:46.807885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57926-71f6-4824-97df-ebdf055127e9 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:46.810214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 743/1479] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:46.816806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f36d-14b7-4a8d-92e7-34aec6980cc9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:46.817484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f36d-14b7-4a8d-92e7-34aec6980cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:46.817581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f36d-14b7-4a8d-92e7-34aec6980cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:46.847981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7bc4f36d-14b7-4a8d-92e7-34aec6980cc9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:46.849267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7bc4f36d-14b7-4a8d-92e7-34aec6980cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:46.860110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 737/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:46.905786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57926-71f6-4824-97df-ebdf055127e9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:46.921457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57926-71f6-4824-97df-ebdf055127e9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:46.927075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:46.927738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:46.928019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:46.928292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:46.936583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:46.938202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf2ef6-4068-481b-aa3c-86994453241f service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:46.948200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 744/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:46:49.136677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0621b-8aff-4bea-a1bb-2fb232cd7a83 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:49.137605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0621b-8aff-4bea-a1bb-2fb232cd7a83 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:49.137605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0621b-8aff-4bea-a1bb-2fb232cd7a83 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:49.139958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 738/1482] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:49.145408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b953f3-8e46-46f4-add6-0ec7324a111d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:49.145873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b953f3-8e46-46f4-add6-0ec7324a111d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:49.145978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b953f3-8e46-46f4-add6-0ec7324a111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:49.164460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-40b953f3-8e46-46f4-add6-0ec7324a111d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:49.165767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-40b953f3-8e46-46f4-add6-0ec7324a111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:49.175699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 745/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:49.215735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0621b-8aff-4bea-a1bb-2fb232cd7a83 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:49.231861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0621b-8aff-4bea-a1bb-2fb232cd7a83 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:49.236911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:49.237547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:49.237849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:49.238108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:49.247413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:49.248891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c226f1-026d-4cfd-bff5-242521ec178c service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:49.258867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 739/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:51.321519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085a828-a1e5-499e-b6b5-102df2d1332a None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:51.322097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085a828-a1e5-499e-b6b5-102df2d1332a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:51.322097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085a828-a1e5-499e-b6b5-102df2d1332a None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:51.324103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 746/1485] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:51.331374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db93d3-72ab-46c2-a912-3bd90cffd8a9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:51.331835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db93d3-72ab-46c2-a912-3bd90cffd8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:51.331943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db93d3-72ab-46c2-a912-3bd90cffd8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:51.351027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b4db93d3-72ab-46c2-a912-3bd90cffd8a9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:51.352258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b4db93d3-72ab-46c2-a912-3bd90cffd8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:51.361646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 740/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:51.403552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085a828-a1e5-499e-b6b5-102df2d1332a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:51.423947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085a828-a1e5-499e-b6b5-102df2d1332a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:51.428572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:51.429251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:51.429530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:51.429781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:51.439953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:51.441419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56976e6b-999f-4b18-ae33-3d903d058070 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:51.451067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 747/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:53.630142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9e21-7db2-4ec5-b3e7-8e6fa774c41b None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:53.630739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9e21-7db2-4ec5-b3e7-8e6fa774c41b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:53.630739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e9e21-7db2-4ec5-b3e7-8e6fa774c41b None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:53.632084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 741/1488] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:46:53.638522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca893790-0a76-4239-a130-2a9561a94b82 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:53.639222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca893790-0a76-4239-a130-2a9561a94b82 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:53.639429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca893790-0a76-4239-a130-2a9561a94b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:53.660676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ca893790-0a76-4239-a130-2a9561a94b82 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:53.661929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ca893790-0a76-4239-a130-2a9561a94b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:53.671757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 748/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:53.716790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9e21-7db2-4ec5-b3e7-8e6fa774c41b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:53.736203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e9e21-7db2-4ec5-b3e7-8e6fa774c41b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:53.740681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:53.741418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:53.741701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:53.741972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:53.752026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:53.753500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f9c2c-8cce-4468-b817-bd6ccd0ec12a service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:53.763163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 742/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:46:56.086383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0273-b9dd-4776-ad4b-bb0dfb9bf705 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:56.086992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0273-b9dd-4776-ad4b-bb0dfb9bf705 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:56.086992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0273-b9dd-4776-ad4b-bb0dfb9bf705 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:56.088333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 749/1491] 10.222.0.23 () {54 vars in 926 bytes} [Mon Jun 20 14:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:46:56.094817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b122-5818-428b-8956-64a473f6cac8 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:56.095300 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b122-5818-428b-8956-64a473f6cac8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:56.095860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61b122-5818-428b-8956-64a473f6cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:56.121104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-fe61b122-5818-428b-8956-64a473f6cac8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:46:56.122324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fe61b122-5818-428b-8956-64a473f6cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:46:56.131698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 743/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Mon Jun 20 14:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:46:56.170272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0273-b9dd-4776-ad4b-bb0dfb9bf705 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:46:56.182564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0273-b9dd-4776-ad4b-bb0dfb9bf705 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:46:56.186834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:46:56.187476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:46:56.187773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:46:56.188031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:46:56.198235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:46:56.199715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef783707-d407-41b2-9135-571793a81b48 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:46:56.209452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 750/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:47:06.115585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=33 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:47:06.205104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=33 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:48:20.428641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.429397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.429397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.452579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:48:20.453886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:20.465792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 744/1494] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:48:20.475389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.475918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.475918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.496917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:48:20.498140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:20.508188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 751/1495] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:48:20.512877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.523740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8759d4-6240-448b-b880-d561f4a3b0e7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.529495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.530159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.530445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.530720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.531837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:48:20.532154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.533349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.533349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:48:20.533349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:48:20.534214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.551600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 745/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:48:20.563388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.573401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef48a2e-5b12-4448-85ca-9887e794de7a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.579636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.580312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.580577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.580879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.581572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.583371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.583371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:48:20.583371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:48:20.584576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.622594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 752/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:48:20 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:48:20.626903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.636818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad2c8-a6df-41d6-a42d-6a41b00dd55e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.698053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.698712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.698990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.699257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.699952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.701012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.701012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:48:20.701012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:48:20.702213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.724624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 746/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:48:20 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:48:20.728969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.739650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980f147-7008-4e70-b942-06747d5067e1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.745016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.745672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.745949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.746217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.746938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.747951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.747951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:48:20.747951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:48:20.748854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.763595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 753/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:48:20.768699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.784456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4431-cb46-4105-818d-b1849cd33126 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.793167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.794007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.794288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.794559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.795535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.797020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.797020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:48:20.797020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:48:20.797898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a5c47-4e18-466c-83b1-49f242cceaad admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.811886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 747/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:48:20.818951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:20.832406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4df8b-95b3-4f70-8a45-689a4188eb6f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:20.837335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:20.838211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.838492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.838740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] PATH_INFO: `/v3/projects/9ba3eeec67f7423488f6ea1861525e6b/users/9b0812b31b94495bb7cde923ebe87f3c/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.853559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba3eeec67f7423488f6ea1861525e6b, user_id=9b0812b31b94495bb7cde923ebe87f3c, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:20.854588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:20.854588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:48:20.854588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:48:20.856500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd09c4b4-0c00-4ab1-bf95-5d3f2d24b0ee admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:20.872652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 754/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:48:20 2022] PUT /identity/v3/projects/9ba3eeec67f7423488f6ea1861525e6b/users/9b0812b31b94495bb7cde923ebe87f3c/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:48:20.884277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b254-ce41-473b-b945-0935a7daf8c4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.884584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b254-ce41-473b-b945-0935a7daf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.884902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883b254-ce41-473b-b945-0935a7daf8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:20.912617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9883b254-ce41-473b-b945-0935a7daf8c4 None None] MFA Rules not processed for user `9b0812b31b94495bb7cde923ebe87f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:48:20.913868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9883b254-ce41-473b-b945-0935a7daf8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:20.979359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 748/1502] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:48:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:48:20.998366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f826e-541d-48e9-bf75-5b6bb905a5f3 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:20.998817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f826e-541d-48e9-bf75-5b6bb905a5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:20.999251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f826e-541d-48e9-bf75-5b6bb905a5f3 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.001261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 755/1503] 10.222.0.23 () {54 vars in 963 bytes} [Mon Jun 20 14:48:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:48:21.006375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffea0a-3ee7-4100-aa30-35ca4265f0b9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.006665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffea0a-3ee7-4100-aa30-35ca4265f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.006930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffea0a-3ee7-4100-aa30-35ca4265f0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.026369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-feffea0a-3ee7-4100-aa30-35ca4265f0b9 None None] MFA Rules not processed for user `4e17921df6504f73b8a743b477924590`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:48:21.027432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-feffea0a-3ee7-4100-aa30-35ca4265f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:21.073137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:48:21.082765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 749/1504] 10.222.0.23 () {58 vars in 1060 bytes} [Mon Jun 20 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:48:21.091138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f826e-541d-48e9-bf75-5b6bb905a5f3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:21.103642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f826e-541d-48e9-bf75-5b6bb905a5f3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:21.107572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:21.108202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.108484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.108840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.117663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:21.119094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:21.128248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 756/1505] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:48:21.178524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa291-4f5e-4774-afc2-bdd82c82f7e2 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.178887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa291-4f5e-4774-afc2-bdd82c82f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.179239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fa291-4f5e-4774-afc2-bdd82c82f7e2 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.181251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 750/1506] 10.222.0.23 () {52 vars in 829 bytes} [Mon Jun 20 14:48:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:48:21.185053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:21.259168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dcd4a-fe75-4bcb-88bd-ad230bee590f service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:21.264813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:21.266122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.266416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.266673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] PATH_INFO: `/v3/users/9b0812b31b94495bb7cde923ebe87f3c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.268027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b0812b31b94495bb7cde923ebe87f3c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:21.269110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:21.269110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:48:21.269110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:48:21.270381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:21.338492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b0812b31b94495bb7cde923ebe87f3c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:21.339151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b0812b31b94495bb7cde923ebe87f3c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:21.358044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b0812b31b94495bb7cde923ebe87f3c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:21.368433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b0812b31b94495bb7cde923ebe87f3c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:21.369139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b0812b31b94495bb7cde923ebe87f3c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:21.382798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:48:21.395714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 757/1507] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:48:21 2022] DELETE /identity/v3/users/9b0812b31b94495bb7cde923ebe87f3c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:48:21.400246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.400535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.400839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.419348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:48:21.420574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:21.480380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 751/1508] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:48:21.490853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:21.492558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:21.555295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f731-0029-4439-bb48-20bacabafd6a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:21.559119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:21.559772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.560055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.560334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.570646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:21.572094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835305d-8a3b-45ed-a069-c4f71c95f80f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:21.582540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 758/1509] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:48:21.964936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:48:21.966491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:48:21.979549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692b3f-e86f-4c99-bcdb-8d9f5bd4a1e8 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:48:21.985360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:48:21.986242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:48:21.986525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:48:21.986796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] PATH_INFO: `/v3/projects/9ba3eeec67f7423488f6ea1861525e6b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:48:21.988113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba3eeec67f7423488f6ea1861525e6b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:48:21.989203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:48:21.989203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:48:21.989203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:48:21.990439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:48:22.059398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba3eeec67f7423488f6ea1861525e6b', 'request_id': 'req-99780ab8-de3a-4cac-9c22-65e11abbb727'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:22.074011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba3eeec67f7423488f6ea1861525e6b', 'request_id': 'req-99780ab8-de3a-4cac-9c22-65e11abbb727'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:22.081098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba3eeec67f7423488f6ea1861525e6b', 'request_id': 'req-99780ab8-de3a-4cac-9c22-65e11abbb727'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:22.096104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] The token cache is being invalidate because project 9ba3eeec67f7423488f6ea1861525e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:48:22.096392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:22.097148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99780ab8-de3a-4cac-9c22-65e11abbb727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:48:22.098724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 752/1510] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:48:21 2022] DELETE /identity/v3/projects/9ba3eeec67f7423488f6ea1861525e6b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:48:31.577486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=29 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:48:32.093137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:01.248741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:01.249359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:01.249359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:01.250671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:01.255669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab965c-6994-4655-a866-78a411204004 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:01.256114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab965c-6994-4655-a866-78a411204004 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:01.256214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab965c-6994-4655-a866-78a411204004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:01.276231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a8ab965c-6994-4655-a866-78a411204004 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:01.277395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a8ab965c-6994-4655-a866-78a411204004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:01.341401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:01.495814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:01.498864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:01.586818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7e132-4767-4dab-ac0c-4dd5a3aebece None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:01.593443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:01.594101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:01.594380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:01.594653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:01.603606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:01.605272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3197d-54fa-4957-8d15-df86daaa9542 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:01.615085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 760/1513] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:02.391795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56e8d6-3e4a-4938-8912-94c6a8297985 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:02.392376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56e8d6-3e4a-4938-8912-94c6a8297985 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:02.392376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56e8d6-3e4a-4938-8912-94c6a8297985 None None] PATH_INFO: `/v3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:02.393623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 754/1514] 10.222.0.26 () {54 vars in 925 bytes} [Mon Jun 20 14:50:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:50:02.400227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9549d-0ec5-4311-ac1b-2f40bb394503 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:02.400658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9549d-0ec5-4311-ac1b-2f40bb394503 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:02.400812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9549d-0ec5-4311-ac1b-2f40bb394503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:02.422183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3ab9549d-0ec5-4311-ac1b-2f40bb394503 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:02.423496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3ab9549d-0ec5-4311-ac1b-2f40bb394503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:02.445252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8f8c-173c-49b2-8253-bf2fde16b005 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:02.445534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8f8c-173c-49b2-8253-bf2fde16b005 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:02.445843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e8f8c-173c-49b2-8253-bf2fde16b005 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:02.447248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 755/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:02.451855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:02.452204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:02.452541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:02.472697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:02.473962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:02.482317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 756/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:50:02.490484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 761/1517] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jun 20 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:02.633590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:02.647750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b839a5b-dec5-46e3-8ed9-7f7b17430be3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:02.654335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:02.654977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:02.655265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:02.655535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:02.665267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:02.666949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d07290-cccb-4995-8d44-c7db8a8c499a service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:02.677297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 757/1518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:06.313900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d4c2-3b48-4436-bec2-c41055ccc92b None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:06.314832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d4c2-3b48-4436-bec2-c41055ccc92b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:06.314832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3d4c2-3b48-4436-bec2-c41055ccc92b None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:06.316097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 762/1519] 10.222.0.23 () {54 vars in 960 bytes} [Mon Jun 20 14:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:06.322336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad048c-de4c-4c55-b3a1-eb95a6a72f17 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:06.322800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad048c-de4c-4c55-b3a1-eb95a6a72f17 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:06.322926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad048c-de4c-4c55-b3a1-eb95a6a72f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:06.349623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-83ad048c-de4c-4c55-b3a1-eb95a6a72f17 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:06.350850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-83ad048c-de4c-4c55-b3a1-eb95a6a72f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:06.362133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 758/1520] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Jun 20 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:06.370514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3d4c2-3b48-4436-bec2-c41055ccc92b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:06.385612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3d4c2-3b48-4436-bec2-c41055ccc92b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:06.391444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:06.392283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:06.392755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:06.393219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:06.405660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:06.407301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6fec5-99ed-4bda-862c-cefae3417b37 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:06.418268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 763/1521] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:13.903355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548d34-6219-40c8-acff-82a20922a4f4 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:13.904009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548d34-6219-40c8-acff-82a20922a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:13.904228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548d34-6219-40c8-acff-82a20922a4f4 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:13.906376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:13.911930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8b5e-b69a-42d3-83cd-c052115c90fb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:13.912414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8b5e-b69a-42d3-83cd-c052115c90fb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:13.912517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8b5e-b69a-42d3-83cd-c052115c90fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:13.931642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-943e8b5e-b69a-42d3-83cd-c052115c90fb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:13.932893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-943e8b5e-b69a-42d3-83cd-c052115c90fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:13.941694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:14.094650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548d34-6219-40c8-acff-82a20922a4f4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:14.111036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548d34-6219-40c8-acff-82a20922a4f4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:14.117492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:14.118150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:14.118439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:14.118734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:14.127867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:14.129521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5cc425-c457-4837-bded-c41d0cc71be9 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:14.139252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 760/1524] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:14.948782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c1c5-aee0-493a-80a5-b5a42141288c None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:14.949710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c1c5-aee0-493a-80a5-b5a42141288c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:14.949710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26c1c5-aee0-493a-80a5-b5a42141288c None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:14.952091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 20 14:50:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:14.957132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e64dc-5804-468d-a0b9-3886f2c819d9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:14.957570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e64dc-5804-468d-a0b9-3886f2c819d9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:14.957687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e64dc-5804-468d-a0b9-3886f2c819d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:14.977144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1c7e64dc-5804-468d-a0b9-3886f2c819d9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:14.978399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1c7e64dc-5804-468d-a0b9-3886f2c819d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:14.988449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 20 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:15.142763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c1c5-aee0-493a-80a5-b5a42141288c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:15.163496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26c1c5-aee0-493a-80a5-b5a42141288c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:15.169749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:15.170498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:15.170778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:15.171048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:15.180170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:15.181790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de11615-5686-4e3d-9f0b-f4d25475a511 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:15.192330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 766/1527] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:19.145696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:19.146316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:19.146316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:19.148197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:19.154674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0957-090c-4d22-9ccd-78b95966894a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:19.155170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0957-090c-4d22-9ccd-78b95966894a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:19.155284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0957-090c-4d22-9ccd-78b95966894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:19.178356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9f1f0957-090c-4d22-9ccd-78b95966894a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:19.179596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9f1f0957-090c-4d22-9ccd-78b95966894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:19.189024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:19.227910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:19.229994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:19.299055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317989b7-0b6b-47be-9966-00b32b02b21d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:19.303189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:19.303849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:19.304133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:19.304409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:19.315159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:19.316618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555653d-c62a-45d8-ab72-35dd2394e920 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:19.326442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 763/1530] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:21.339113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:21.339989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:21.339989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:21.342162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:21.347767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe14e3-e8b5-45d9-909e-c26e14d5b40e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:21.348202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe14e3-e8b5-45d9-909e-c26e14d5b40e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:21.348314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe14e3-e8b5-45d9-909e-c26e14d5b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:21.367511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3ffe14e3-e8b5-45d9-909e-c26e14d5b40e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:21.368770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3ffe14e3-e8b5-45d9-909e-c26e14d5b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:21.377263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:21.417156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:21.419503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:21.434613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d473-5ffe-47a6-b177-10fc38957dc3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:21.438720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:21.439748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:21.440043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:21.440297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:21.449611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:21.451059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b39fc-689b-474d-93e3-0330d4b0c3d7 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:21.460700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 769/1533] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:25.055680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:25.056227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:25.056227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:25.058277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:25.065672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9746-cfdb-4e7a-8775-abb070e93258 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:25.066082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9746-cfdb-4e7a-8775-abb070e93258 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:25.066262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9746-cfdb-4e7a-8775-abb070e93258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:25.073233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:25.086522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-794c9746-cfdb-4e7a-8775-abb070e93258 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:25.087757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-794c9746-cfdb-4e7a-8775-abb070e93258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:25.096412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:25.407494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:25.410780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:25.421575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=78 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:25.478176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535371a9-a60b-47db-9977-a12d631b1683 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:25.482537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:25.483195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:25.483476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:25.483788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:25.493236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:25.494704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c2e0a-8250-4b06-8c4a-16597e8f6343 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:25.504460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 766/1536] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:27.535489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:27.536091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:27.536091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:27.537473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 20 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:50:27.543742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e54e-db29-40ff-8fc0-4fea02cb073d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:27.544471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e54e-db29-40ff-8fc0-4fea02cb073d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:27.544648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62e54e-db29-40ff-8fc0-4fea02cb073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:27.566780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6d62e54e-db29-40ff-8fc0-4fea02cb073d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:50:27.567995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6d62e54e-db29-40ff-8fc0-4fea02cb073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:27.578103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 20 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:50:27.878085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:50:27.880399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:50:27.897657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42f5b1-ed41-4899-831c-87b540259e72 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:50:27.902651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:50:27.903271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:50:27.903554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:50:27.903830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:50:27.914000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:50:27.915585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b256c-c2c5-4c3f-a157-8d7677408a02 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:50:27.926172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 772/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:50:37.560358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=28 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:50:37.921652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=8 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:58.062074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.062708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.062708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.088986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.090463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.104294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 768/1540] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.115149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c421-58db-448e-96d2-711cb1ff9d88 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.115780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c421-58db-448e-96d2-711cb1ff9d88 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.115780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0c421-58db-448e-96d2-711cb1ff9d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.153423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-dcf0c421-58db-448e-96d2-711cb1ff9d88 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.155031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-dcf0c421-58db-448e-96d2-711cb1ff9d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.165552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 773/1541] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.169859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.180451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc090bd-387a-4436-910f-d4099e1bce6b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.180815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc090bd-387a-4436-910f-d4099e1bce6b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.181033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc090bd-387a-4436-910f-d4099e1bce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.182030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56a3c7-8c75-4aa0-9853-3abd6fd3f2a6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.193123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.194117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.194818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.195305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.196313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.196862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.199011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.213518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8fc090bd-387a-4436-910f-d4099e1bce6b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.214515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8fc090bd-387a-4436-910f-d4099e1bce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.220412 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 769/1542] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.228775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.231878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 774/1543] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 20 14:51:58.244740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442d0d-c4f1-45dd-a050-0cfc8a43d63e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.244740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442d0d-c4f1-45dd-a050-0cfc8a43d63e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.244740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442d0d-c4f1-45dd-a050-0cfc8a43d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.246676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb67e-1a0e-4c52-ab45-122907847d1d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.256609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.257719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.258252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.258773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.259698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.260986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:51:58.260986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:51:58.260986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:51:58.262607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.277664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8d442d0d-c4f1-45dd-a050-0cfc8a43d63e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.278633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8d442d0d-c4f1-45dd-a050-0cfc8a43d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.306160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 775/1544] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.307730 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0679a-a0b8-4a4e-b241-f3c9be2b7078 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.308005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0679a-a0b8-4a4e-b241-f3c9be2b7078 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.308496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0679a-a0b8-4a4e-b241-f3c9be2b7078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.318264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 770/1545] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:51:58.319530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.347869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ffc0679a-a0b8-4a4e-b241-f3c9be2b7078 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.352269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ffc0679a-a0b8-4a4e-b241-f3c9be2b7078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.434811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452f9f-f5cd-4ee7-a413-7bdbdf869536 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.454067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.454758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.455041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.455316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.456068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.456371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.458036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.483835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 771/1546] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.487518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.508239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 776/1547] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.509765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.510059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.510335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.516527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d26-269b-4568-adcc-2399bf8975df admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.526415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.527865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.528160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.528360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.533168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.535608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e06ee5-1635-46e4-b119-36394c644ea1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.543086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.544299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.553914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 777/1548] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.555063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.560691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 772/1549] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:58.562288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b6b8-8227-4e65-b3ed-991f0581259a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.562585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b6b8-8227-4e65-b3ed-991f0581259a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.566882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92b6b8-8227-4e65-b3ed-991f0581259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.567930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8f5b3-b94b-49b0-8fd6-10accc1f7f0e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.580501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.581223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.581500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.581770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.582468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.584561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c4e31-3878-457b-a0d0-ee75d8ffad06 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.587619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6c92b6b8-8227-4e65-b3ed-991f0581259a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.588885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6c92b6b8-8227-4e65-b3ed-991f0581259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.597606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 773/1550] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.598869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1d60-92d3-4beb-8ffb-910265c86cea None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.599158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1d60-92d3-4beb-8ffb-910265c86cea None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.599434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c1d60-92d3-4beb-8ffb-910265c86cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.619841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 778/1551] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:58.619841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa154-3572-4203-b548-e20865188fa5 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.619841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa154-3572-4203-b548-e20865188fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.619841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fa154-3572-4203-b548-e20865188fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.624395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8c1c1d60-92d3-4beb-8ffb-910265c86cea None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.625904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8c1c1d60-92d3-4beb-8ffb-910265c86cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.639036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-125fa154-3572-4203-b548-e20865188fa5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.640294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-125fa154-3572-4203-b548-e20865188fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.686458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 774/1552] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.687754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0619ef-b3c7-4064-a87b-e7708ba4553c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.688041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0619ef-b3c7-4064-a87b-e7708ba4553c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.688321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0619ef-b3c7-4064-a87b-e7708ba4553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.700359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 779/1553] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.701085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fa154-3572-4203-b548-e20865188fa5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.712284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ab0619ef-b3c7-4064-a87b-e7708ba4553c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.713538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ab0619ef-b3c7-4064-a87b-e7708ba4553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.714745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fa154-3572-4203-b548-e20865188fa5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.719808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.720483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.720798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.721069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.721800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.721914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 775/1554] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.723243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.723461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fa747-4b32-4a8f-9dc8-40b5b1b30625 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.723555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.723785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.734914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 780/1555] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:58.736065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74f6a-0e97-4fa1-b8aa-b8560281a6ab None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.736358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74f6a-0e97-4fa1-b8aa-b8560281a6ab None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.737012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce74f6a-0e97-4fa1-b8aa-b8560281a6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.742804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.744418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.753751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 776/1556] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.754502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.757089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6ce74f6a-0e97-4fa1-b8aa-b8560281a6ab None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.759024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6ce74f6a-0e97-4fa1-b8aa-b8560281a6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.766310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d594a4-5b52-4365-8db9-53f2e3297ffa None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.770957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.771616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.771894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.772344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 781/1557] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.772468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.773011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.773563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d57d-a3f8-404a-8f72-41a31abb3dde None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.774365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d57d-a3f8-404a-8f72-41a31abb3dde None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.774683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33d57d-a3f8-404a-8f72-41a31abb3dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.775029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.795677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:58.796017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2a33d57d-a3f8-404a-8f72-41a31abb3dde None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.797157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2a33d57d-a3f8-404a-8f72-41a31abb3dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.806030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 777/1558] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:58.806825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 782/1559] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.807251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.808082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.808371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.808652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.818862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feb795-d1db-420c-b1c2-3a7aa446de5a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.823800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.824454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.824754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.825029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.825756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.826193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.827502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.827840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.828804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.837289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 783/1560] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.838078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.844904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 778/1561] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.846189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.847394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785b345-237d-4af9-b35e-d7ad123275ae None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.852000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.853302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.853592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.853869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.854606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.854913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.855918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:51:58.855918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:51:58.855918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:51:58.856831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96562d4-f681-4bb1-a83c-2e164a657081 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.857705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f614de-d8c5-481d-941b-8fc87eed6c72 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.864443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.865136 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.865416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.865683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.867032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.868644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.869993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 784/1562] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.871105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.871630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.871914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.882474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 779/1563] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:58.883953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.892156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.893589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e46ef9-4315-401e-ba21-7aa93d1c39bd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.893737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.898251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.899530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.899833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.900135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.900897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.901183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.902818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17732ac-62fd-41a8-98b4-1412265264a2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.902975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 785/1564] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.903853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.908783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:58.922349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 780/1565] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.922542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd20d6-6ef9-4f90-8fe7-5ef5d38da9d2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.922661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.922661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.922661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.922909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.922909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.922909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.922909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.923490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.925310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.935524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:58.936454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 786/1566] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:58.936754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:58.937364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.945082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 781/1567] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:58.945921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.951649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528baf6-938d-469e-a22c-ea5de1d2b3a4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.955174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647aba1-39d9-4837-a0d8-cd6fc8344c1c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.956291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.956981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.957262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.957532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.958248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:58.958557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.960146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.961369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.962129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.962413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.962694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.963376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.965343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:58.979089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 787/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:58.979089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:58.984047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a915108c-db7c-4a32-b613-3f2cc8a513c4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:58.990536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:58.991629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:58.992076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:58.992505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:58.993254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:58.995329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.003679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 782/1569] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.003679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.038110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 788/1570] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:58 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.039272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.075196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edf414-f4a6-4849-945e-ecb070eb84b4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.101513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadd1d-1fef-442c-b6ab-5a085a1f1d64 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.106892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.107561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.107848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.108145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.108903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:59.109216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.110874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.123801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 789/1571] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:59.124653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.135666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.136573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.136858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.137162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] PATH_INFO: `/v3/projects/532cbc0c846c4a528fccd85b0b8ab4d8/users/87c3f39c0bed4fadbc8a556c857baf4a/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.140760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00db25-16cd-4603-85fe-4ce880e1b141 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.145807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.146579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.146866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.147251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.147939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.149942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.152958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532cbc0c846c4a528fccd85b0b8ab4d8, user_id=87c3f39c0bed4fadbc8a556c857baf4a, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.153993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:51:59.153993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:51:59.153993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:51:59.155935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.170062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 783/1572] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:51:59 2022] PUT /identity/v3/projects/532cbc0c846c4a528fccd85b0b8ab4d8/users/87c3f39c0bed4fadbc8a556c857baf4a/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:51:59.170662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.180191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 790/1573] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.180191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.197579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.238698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1c82b-5694-4dbf-8c6a-1dec09d4ac04 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.239988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f7b98-2446-41ce-a9dc-709c56232947 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.243353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.244017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.244295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.244560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.245307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.245418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.246066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.246347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.246617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.247035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.247345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:51:59.247652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.249282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.257556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 784/1574] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.259592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.261370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 791/1575] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:51:59.262181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.272468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63049cdc-d222-429f-8b0c-e47f42a30d59 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.273513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c7466-5a2b-4447-89b7-e2d8ebfd0763 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.278227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.278385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.278882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.278982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.279164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.279264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.279433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.279623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.280126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.280379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.281435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:51:59.281435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:51:59.281435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:51:59.282092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.282633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.304561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 792/1576] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.305381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.308771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 785/1577] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.309688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.313068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.317416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142f5bb-c631-4e75-806d-5b26de0d8032 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.373473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.374074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.374184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8a8c0-c3f4-4e08-bda3-de0f75073f6d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.374353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.374625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.375317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.377280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f290e-173d-45f9-b153-96f427615113 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.379009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.379661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.379938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.380210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.380933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.382857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.399851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 793/1578] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.401468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.401781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.402083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.409649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 786/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.410523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.421759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:59.422949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:59.473494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254386-4dbc-405a-862e-268dfef23036 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.478187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.478855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.479139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.479406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.480091 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.481201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 794/1580] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:59.482055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.482165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.493970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40becf55-2055-4e66-b2d4-870dc40acf42 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.499547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.500449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.500742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.501029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] PATH_INFO: `/v3/projects/bd09d185eb7f41999e0373a3d701d5e4/users/95d9ab41801744e78c956b2a9fddd773/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.505722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 787/1581] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.505722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.512838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf58036-1574-432a-a766-c08c0a4f1487 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.517569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.518207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.518484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.518604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd09d185eb7f41999e0373a3d701d5e4, user_id=95d9ab41801744e78c956b2a9fddd773, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.518752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.519435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.521336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.521458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.530634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.536065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 795/1582] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:51:59 2022] PUT /identity/v3/projects/bd09d185eb7f41999e0373a3d701d5e4/users/95d9ab41801744e78c956b2a9fddd773/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:51:59.537111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.564903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 788/1583] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.564903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.601208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a1d3b-9806-4b17-9fc1-9c0b384965dd admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.613803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:51:59.629359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe3eb4-2019-4281-b8ca-8fa8264a1ca2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.634804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.635487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.635770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.636046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.636793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.638759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.660933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 789/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.661147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.661654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.661885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.661980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.662230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.662920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.664644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.671575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5e057-ad37-4353-bf6c-13c226b8ce9d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.674900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 796/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.675558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.676322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.677001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.677281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.677847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.678594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.680274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.684924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905237d-846b-4aa6-9628-d4592ab86f7e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.689965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.693552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 790/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.693687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.693687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.693687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.693964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.694065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.694065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.714509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 797/1587] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 303 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.717711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.728029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0d31-a753-49b8-8291-7d5aadee7d1b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.733153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.733817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.734103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.734378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.735111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.736694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cef5d-9a19-4cc1-8b64-f850d4acb819 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.747707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 798/1588] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.748954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.749259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.749536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.754160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbc34e-a4ad-4f4b-8b5c-9e7f828cec38 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.758318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.758951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.759228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.759495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.768999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.770548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.775646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] MFA Rules not processed for user `95d9ab41801744e78c956b2a9fddd773`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:51:59.777022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:51:59.780865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 791/1589] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:51:59.781766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.791852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaf8aa-b81b-4018-91d9-16d6bc290fff service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.796898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.797635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.797923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.798198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.798886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.801127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.826507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 792/1590] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:51:59.830598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.843033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a564b-f2c6-415b-943c-370f1d0597af admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.847420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 799/1591] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:51:59.848291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.849667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.850387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.850668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.850939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.851731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.853503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.861317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ada66-7353-48a2-a91c-6c68e6e6d7e4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.865067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 793/1592] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.865656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.869500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.870528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.871470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.871470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.872580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.873741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.877197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf39c4-0b99-4ab6-96d0-9a86210175cf admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.886121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 800/1593] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.886938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.889866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.890615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.890965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.891319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.892133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.894411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.898328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11e765-7085-4465-980f-dd213fe981af admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.904366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.905172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.905455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.906391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.906612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.908493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.923473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 801/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.923473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.924577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 794/1595] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.925627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.934607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68771b15-b743-41aa-a48a-b824f4e431b7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.937996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b0e7-3995-46fa-a536-8bb00ddaa1d8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.940570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.941366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.942035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.942151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.943035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.943534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.944539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.944859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.945036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.945452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.946295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.947994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194b64e-f579-4169-99cd-10d2b6dadf04 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.959905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 802/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.959905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.960210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 795/1597] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.961171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccadc3-75eb-448e-952a-7515ca245b7d None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.961587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccadc3-75eb-448e-952a-7515ca245b7d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.961977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccadc3-75eb-448e-952a-7515ca245b7d None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.963518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 796/1598] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jun 20 14:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:51:59.964178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccadc3-75eb-448e-952a-7515ca245b7d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:51:59.973007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f57b6e-0169-4a6d-a7af-11e1884d5c85 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.978300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.978987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.979293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.979587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.980140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccadc3-75eb-448e-952a-7515ca245b7d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:51:59.980398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:51:59.982077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:51:59.985364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:51:59.986516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:51:59.987031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:51:59.987466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] PATH_INFO: `/v3/projects/78627db930574b51b53a4f8447056630/users/edf609dc8c5e4cf8a9f534153858cbc8/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:51:59.995918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 803/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:51:59.997630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.013247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=78627db930574b51b53a4f8447056630, user_id=edf609dc8c5e4cf8a9f534153858cbc8, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.013738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdeae4-b975-4aac-905c-2a22e8d318a7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.016432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.019077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.019762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.020046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.020387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.020824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.021564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.023462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.033122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 797/1600] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:51:59 2022] PUT /identity/v3/projects/78627db930574b51b53a4f8447056630/users/edf609dc8c5e4cf8a9f534153858cbc8/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.033959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.034970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 804/1601] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:00.035881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.048525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9625e0-8fb6-4f4f-89ca-9f796f3fef00 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.070892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.104093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385b2c-422b-4b1b-a912-0b8bd5028dea admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.109501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.110404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.110781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.111129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] PATH_INFO: `/v3/projects/0acd9503f5f840388bafb9889cddca56/users/4306c068736f4e9faacb860faa851eb7/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.128811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acd9503f5f840388bafb9889cddca56, user_id=4306c068736f4e9faacb860faa851eb7, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.131687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.132448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.134799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.135701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.136459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] PATH_INFO: `/v3/projects/1333ac4890624e11941a2681b51b07ab/users/afc8379be09748a68ade6af9b99cdfa2/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.148495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 798/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:00 2022] PUT /identity/v3/projects/0acd9503f5f840388bafb9889cddca56/users/4306c068736f4e9faacb860faa851eb7/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.149841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.162239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1333ac4890624e11941a2681b51b07ab, user_id=afc8379be09748a68ade6af9b99cdfa2, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.165226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f7ad-fe6c-485e-ad62-2b537bd31910 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.186055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 805/1603] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:00 2022] PUT /identity/v3/projects/1333ac4890624e11941a2681b51b07ab/users/afc8379be09748a68ade6af9b99cdfa2/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.188310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.188780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.189789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.213825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.215554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.241613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494015b1-ca26-400a-9c7d-ecb0ee47a7bd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.305663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.306348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.306628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.306901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.307705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.309668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.312566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 806/1604] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.313465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.323730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 799/1605] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:00.325035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.328661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad31a1d-8bad-43a0-ad12-c87f8c1c9b5a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.334846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.335304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ecbda-cea5-489c-a0ce-5f07c6b83be1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.335994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.336447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.336893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] PATH_INFO: `/v3/projects/361bd83b835c4ec3b01a1173b2d9cb1d/users/75ebe0d05a1c4b66aa3b3abebd0ce026/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.340003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.340942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.341203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.341544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] PATH_INFO: `/v3/projects/a1b38d95652c4cdaa5b84dd9e0d3d644/users/833d253218454d7d8994c1141cb19a6c/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.353444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=361bd83b835c4ec3b01a1173b2d9cb1d, user_id=75ebe0d05a1c4b66aa3b3abebd0ce026, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.356209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04829485-3478-44e4-8535-3119188fe395 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.356755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b38d95652c4cdaa5b84dd9e0d3d644, user_id=833d253218454d7d8994c1141cb19a6c, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.359438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848e15c-4454-4703-ae6e-5f5319a4c0b9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.370240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.371645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 807/1606] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:00 2022] PUT /identity/v3/projects/361bd83b835c4ec3b01a1173b2d9cb1d/users/75ebe0d05a1c4b66aa3b3abebd0ce026/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.376940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4bba-b402-48e6-b69a-cb6f2411b10a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.377232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4bba-b402-48e6-b69a-cb6f2411b10a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.377514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d4bba-b402-48e6-b69a-cb6f2411b10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.381568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 800/1607] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:00 2022] PUT /identity/v3/projects/a1b38d95652c4cdaa5b84dd9e0d3d644/users/833d253218454d7d8994c1141cb19a6c/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.383589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.384028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.384582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.410640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a60d4bba-b402-48e6-b69a-cb6f2411b10a None None] MFA Rules not processed for user `edf609dc8c5e4cf8a9f534153858cbc8`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.411924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a60d4bba-b402-48e6-b69a-cb6f2411b10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.414451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] MFA Rules not processed for user `4306c068736f4e9faacb860faa851eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.415798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.481563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.487067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 808/1608] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.488604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.489121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.489519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.497493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 801/1609] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.498625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.512035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.513399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.595440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 809/1610] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.596323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b9d5a-b6b7-45f5-9f20-5369105c9d3d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.596462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.602850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.603846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.604223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.604553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.613641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c9df7-f0bd-455b-8339-a666303a1ac0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.619197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.620081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.620364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.620644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] PATH_INFO: `/v3/projects/d707620ca5d640f78d1a8d5cf64358e2/users/7026acdb52b844acbe60b4974e5a4ffc/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.638191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d707620ca5d640f78d1a8d5cf64358e2, user_id=7026acdb52b844acbe60b4974e5a4ffc, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.641159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b832-70f2-4edb-ac0c-60c514cfa1c8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.667561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 810/1611] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:00 2022] PUT /identity/v3/projects/d707620ca5d640f78d1a8d5cf64358e2/users/7026acdb52b844acbe60b4974e5a4ffc/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:00.668993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.669284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.669560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.684420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.686090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4adbd-da9f-48b1-a2fa-036417336252 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.688479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.689924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.696446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 802/1612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:00.697850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.698143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.698418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.716670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.718034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.739839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.771660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 811/1613] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.772999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.786509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905be3-81cf-4ab1-a653-7a90c839db5d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.793336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.794005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.794333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.794773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.795936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.798311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.818186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 803/1614] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:00.819488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.829774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fae886-8c0a-4d1d-b418-86df325e0e0e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.833808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 812/1615] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:00.834783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:00.837628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:00.838313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.838598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.838873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.839626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:00.841663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7146965-a996-43b9-bc10-a95568bef7c8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:00.889689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 804/1616] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/projects => generated 371 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:00.889689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:00.889689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:00.890089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:00.913787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6781bb-57bc-4347-af4e-76aa78d2a165 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:00.926816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:00.936198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] MFA Rules not processed for user `7026acdb52b844acbe60b4974e5a4ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:00.937455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:00.998704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.000024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.001474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.003536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.021636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 805/1617] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:01.022703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.057266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8882-02ae-49eb-b35f-fb60e082903a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.062854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.064176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.064690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.065464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.121740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.123468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.135011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 813/1618] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:01.146557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.147722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.150469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.163857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 806/1619] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:01.166085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.169350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef711a26-88de-4c67-958e-7d6489558e2a service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.181209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.181907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.182198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.182498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.187775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b269a-0e61-4e3d-ad06-45df2a28b74f service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.203535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.204250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.205879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.206177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.207460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.208965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.209212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.211307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc59509-6fbc-4816-9eb1-0cd173af5d3b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.221323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 814/1620] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:01.222207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.234534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bca6f8-e342-4420-8e90-f566128d5f19 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.245558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.247078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.247706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.248238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.250159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.257108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc06dad-7fd8-4711-8c9d-06cfd7ad2c96 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.266690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 807/1621] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:01 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:01.267597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d2d7-96e3-4107-a0f3-bc830eec65b7 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.267880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d2d7-96e3-4107-a0f3-bc830eec65b7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.268143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395d2d7-96e3-4107-a0f3-bc830eec65b7 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.270607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 808/1622] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jun 20 14:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:01.271739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652b4a-e54a-4740-a9a1-51fdb464b86c None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.272010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652b4a-e54a-4740-a9a1-51fdb464b86c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.272279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652b4a-e54a-4740-a9a1-51fdb464b86c None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.273567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 809/1623] 10.222.0.23 () {54 vars in 961 bytes} [Mon Jun 20 14:52:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:01.290760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652b4a-e54a-4740-a9a1-51fdb464b86c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.299511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 815/1624] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:01 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:01.299511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.299511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.299511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.316798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652b4a-e54a-4740-a9a1-51fdb464b86c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.324041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.324744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.325020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.325289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.326041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.326312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:01.327625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49803a-4401-4ca5-9d46-258e5785bd87 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.328239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:01.332151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.344983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 810/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:01.348133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.348421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.348699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.401031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:01.404704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:01.486465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 816/1626] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:01.491527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.510649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7cf7d6-66d3-4d76-8307-5cbb33054bba None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.521627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.522523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.522805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.523103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.524969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.528268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.563270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 817/1627] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:01.563486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 811/1628] 10.222.0.23 () {58 vars in 1058 bytes} [Mon Jun 20 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:01.564146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.571464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.600974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec82732-ddcf-41df-b095-256fbdd8711c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.609248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.610321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.610611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.610892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] PATH_INFO: `/v3/projects/91c24c4c26324fc585121efee9d4f902/users/54b99aab9603432aa7d4f1c2f73bcc93/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.624289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.637101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c24c4c26324fc585121efee9d4f902, user_id=54b99aab9603432aa7d4f1c2f73bcc93, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.646067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.668372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 818/1629] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:01 2022] PUT /identity/v3/projects/91c24c4c26324fc585121efee9d4f902/users/54b99aab9603432aa7d4f1c2f73bcc93/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:01.669654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.677118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9a64-4b73-4557-83b9-214229939a91 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.845350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8642b-20e5-4346-85e2-8dcce3f8e988 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:01.847527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.847527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.848422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:01.848422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:01.848422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.849210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:01.849210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.849395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] PATH_INFO: `/v3/projects/c61fef70cdf14c87b50dbeb35927ab08/users/92c3a5e4b16346029af014322fbdd1b3/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:01.877069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61fef70cdf14c87b50dbeb35927ab08, user_id=92c3a5e4b16346029af014322fbdd1b3, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.886188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:01.921420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 819/1630] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:01 2022] PUT /identity/v3/projects/c61fef70cdf14c87b50dbeb35927ab08/users/92c3a5e4b16346029af014322fbdd1b3/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:01.922003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:01.950951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:01.979816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:01.981492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.019949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 812/1631] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:02.036562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.057835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efc1c0-d74c-4283-813d-1f1c1ef1871b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.065259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.065897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4efb-6637-4a87-92aa-e9546011aef7 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.066040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.066307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.066690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.215513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.218860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.226236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.226968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.227100 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.227379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.228917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.233035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.244970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 813/1632] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:02.246287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.266969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 820/1633] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:02.269363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.300291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf937e2-8149-48bb-b4f9-9c951ea76d9c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.302215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d9432-aa58-4021-abd1-38e077bed0f4 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.309112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.309806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.310089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.310365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.311202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.312862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.325576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.327463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 814/1634] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:02.328993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.329280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.329558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] PATH_INFO: `/v3/projects/91c24c4c26324fc585121efee9d4f902/users/54b99aab9603432aa7d4f1c2f73bcc93/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.330866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.337590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c24c4c26324fc585121efee9d4f902, user_id=54b99aab9603432aa7d4f1c2f73bcc93, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.343631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd7d3c-f99d-4d2e-83f9-98946e722451 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.347239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca5148-3c28-4abd-8fb1-e51e495780df admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.349907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:02.364530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.367732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.368491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.370910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] PATH_INFO: `/v3/projects/c61fef70cdf14c87b50dbeb35927ab08/users/92c3a5e4b16346029af014322fbdd1b3/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.378771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61fef70cdf14c87b50dbeb35927ab08, user_id=92c3a5e4b16346029af014322fbdd1b3, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.379387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 821/1635] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:02 2022] PUT /identity/v3/projects/91c24c4c26324fc585121efee9d4f902/users/54b99aab9603432aa7d4f1c2f73bcc93/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:02.382101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e54547-f28b-42fb-abe1-d4db9138ecb0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.396424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b447501-428a-466e-8094-10260be18731 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.396741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b447501-428a-466e-8094-10260be18731 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.397019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b447501-428a-466e-8094-10260be18731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.411631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 815/1636] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:02 2022] PUT /identity/v3/projects/c61fef70cdf14c87b50dbeb35927ab08/users/92c3a5e4b16346029af014322fbdd1b3/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:02.429333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832f5a-4f2b-4f02-b524-76543aa02224 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.430123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832f5a-4f2b-4f02-b524-76543aa02224 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.430123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac832f5a-4f2b-4f02-b524-76543aa02224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.488169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ac832f5a-4f2b-4f02-b524-76543aa02224 None None] MFA Rules not processed for user `92c3a5e4b16346029af014322fbdd1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:02.489452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ac832f5a-4f2b-4f02-b524-76543aa02224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:02.492700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1b447501-428a-466e-8094-10260be18731 None None] MFA Rules not processed for user `54b99aab9603432aa7d4f1c2f73bcc93`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:02.496343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1b447501-428a-466e-8094-10260be18731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:02.675141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 822/1637] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:02.683619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b447501-428a-466e-8094-10260be18731 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.693164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 816/1638] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:02.694687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0884c7-b9cd-49cb-83ad-e03971608ef3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.694924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0884c7-b9cd-49cb-83ad-e03971608ef3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.698481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0884c7-b9cd-49cb-83ad-e03971608ef3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.700820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 817/1639] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jun 20 14:52:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:02.711450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.711721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.711964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.745177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:02.746444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:02.799539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b447501-428a-466e-8094-10260be18731 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:02.812409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:02.813059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:02.813344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:02.813621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:02.834798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:02.837775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:02.839772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:02.861784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 823/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:02.909483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 818/1641] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:02.976168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:02.994675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:03.014312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491d4e2-3d9f-4c58-ab95-cac343c2ac76 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:03.018517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f1911-b67c-423a-b291-3bb0d3d211b1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:03.036829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:03.038472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:03.040701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:03.041989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:03.043851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:03.044342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:03.045149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:03.046368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:03.077317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:03.079581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2ec76-f90f-4ab3-bd6d-a613dddb60b6 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:03.080559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:03.088149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:03.107168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 824/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:03.135963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 819/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:03.463329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:03.464181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:03.464181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:03.527919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] MFA Rules not processed for user `833d253218454d7d8994c1141cb19a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:03.528831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:03.652992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:03.660319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:03.662058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee5cd69-cac2-43b0-9852-d6de9a01c08d service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:03.672676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 825/1644] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:03.674338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:03.674997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:03.675274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:03.675542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:03.677466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:03.801826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:03.807822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:03.841071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 820/1645] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:03.864982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b9000-cda7-4885-b852-95ee77cbd29b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:03.898227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:03.902103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:03.905408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:03.907303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:03.908225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:03.915699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:03.980869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 826/1646] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:03 2022] POST /identity/v3/projects => generated 405 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:03.983804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.002858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d8306-2894-4721-9b8d-5b878288d329 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.253034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:04.253712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:04.253992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:04.254272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:04.259278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:04.264750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:04.331797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 821/1647] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:03 2022] POST /identity/v3/users => generated 309 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:04.333005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.358237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5c7e7-409c-4ee4-97c3-cfe078092128 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.396682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:04.398473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:04.398912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:04.399525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:04.406429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:04.408071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:04.444734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 827/1648] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:04.449223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.475166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ebcf4-cea2-4cac-ad14-caa32e1e86cb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.498689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:04.499598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:04.499933 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:04.500255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] PATH_INFO: `/v3/projects/87cf38422d7e4368b24b270f13e9629d/users/04e9499d796d420d8518217aa322f3ce/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:04.533353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cf38422d7e4368b24b270f13e9629d, user_id=04e9499d796d420d8518217aa322f3ce, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:04.537048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:04.561814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 822/1649] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:04 2022] PUT /identity/v3/projects/87cf38422d7e4368b24b270f13e9629d/users/04e9499d796d420d8518217aa322f3ce/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:04.569151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.588193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b8aa-c621-458c-bf0b-17c07086d078 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.797539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:04.800140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:04.800589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:04.801659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:04.807860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:04.819319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:04.848642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 828/1650] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:04.850132 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.866274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be89b7-30c7-437e-829f-5fb371d41cf6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.883179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:04.885638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:04.885930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:04.886213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] PATH_INFO: `/v3/projects/87cf38422d7e4368b24b270f13e9629d/users/04e9499d796d420d8518217aa322f3ce/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:04.896236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87cf38422d7e4368b24b270f13e9629d, user_id=04e9499d796d420d8518217aa322f3ce, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:04.903590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e56b2b-13f2-4373-98cf-c3c20daecd81 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:04.926887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:04.943408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc6be8-9387-409b-b2b8-0c719025baad admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:04.949531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 823/1651] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:04 2022] PUT /identity/v3/projects/87cf38422d7e4368b24b270f13e9629d/users/04e9499d796d420d8518217aa322f3ce/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:05.059762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:05.061442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:05.061987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:05.063079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] PATH_INFO: `/v3/users/4306c068736f4e9faacb860faa851eb7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:05.068805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4306c068736f4e9faacb860faa851eb7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:05.074736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:05.107985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:05.218726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4306c068736f4e9faacb860faa851eb7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:05.220113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4306c068736f4e9faacb860faa851eb7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:05.256623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4306c068736f4e9faacb860faa851eb7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:05.278324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4306c068736f4e9faacb860faa851eb7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:05.279537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4306c068736f4e9faacb860faa851eb7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:05.308356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 829/1652] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:04 2022] DELETE /identity/v3/users/4306c068736f4e9faacb860faa851eb7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:05.315925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:05.316225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:05.316578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:05.349632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:05.350890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:05.379019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:05.490573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 824/1653] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:05.523775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:05.525570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:05.738527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32662a4-4b61-42f4-87c1-810599246492 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:05.755312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:05.756001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:05.756286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:05.756569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:05.793652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:05.798241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736b1c3-88b4-4c61-ac75-6ddbfcf3e246 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:05.831823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 830/1654] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:07.720762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:07.723286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:07.737770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973b730-797d-4d38-a24c-b63cc3135bb5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:07.745187 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:07.746306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:07.746773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:07.747409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] PATH_INFO: `/v3/projects/0acd9503f5f840388bafb9889cddca56` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:07.749167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acd9503f5f840388bafb9889cddca56)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:07.752147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:07.776046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:07.776688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:07.776688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:07.835060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] MFA Rules not processed for user `04e9499d796d420d8518217aa322f3ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:07.836638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:07.889046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acd9503f5f840388bafb9889cddca56', 'request_id': 'req-eb7ca220-df69-4a96-b3ec-701a15c31f60'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:07.909072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acd9503f5f840388bafb9889cddca56', 'request_id': 'req-eb7ca220-df69-4a96-b3ec-701a15c31f60'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:07.942324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acd9503f5f840388bafb9889cddca56', 'request_id': 'req-eb7ca220-df69-4a96-b3ec-701a15c31f60'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:07.971339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] The token cache is being invalidate because project 0acd9503f5f840388bafb9889cddca56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:07.971634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:07.973134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:07.975259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 825/1655] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:07 2022] DELETE /identity/v3/projects/0acd9503f5f840388bafb9889cddca56 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:07.980042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:07.982974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:08.077636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 831/1656] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:08.151466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ca220-df69-4a96-b3ec-701a15c31f60 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:08.157832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:08.159044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:08.159850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:08.160647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] PATH_INFO: `/v3/users/92c3a5e4b16346029af014322fbdd1b3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:08.167505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c3a5e4b16346029af014322fbdd1b3)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:08.168984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: WARNING py.warnings [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:52:08.168984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: warnings.warn(msg) Jun 20 14:52:08.168984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: Jun 20 14:52:08.170962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:08.328900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:08.350866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c3a5e4b16346029af014322fbdd1b3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:08.353388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c3a5e4b16346029af014322fbdd1b3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:08.354430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c3a5e4b16346029af014322fbdd1b3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:08.377236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c3a5e4b16346029af014322fbdd1b3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:08.416669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-187ef58e-5478-4eb3-9dff-492c2c51ade7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c3a5e4b16346029af014322fbdd1b3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:08.501225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 826/1657] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:07 2022] DELETE /identity/v3/users/92c3a5e4b16346029af014322fbdd1b3 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:09.743761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:09.748473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:09.780885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422ce21-c871-41fe-9495-091a3c84399e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:09.814226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:09.889765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:09.891005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:09.891454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:09.891927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] PATH_INFO: `/v3/users/7026acdb52b844acbe60b4974e5a4ffc` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:09.893400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7026acdb52b844acbe60b4974e5a4ffc)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:09.895560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:10.011769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7026acdb52b844acbe60b4974e5a4ffc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:10.012566 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7026acdb52b844acbe60b4974e5a4ffc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:10.052127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7026acdb52b844acbe60b4974e5a4ffc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:10.076689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7026acdb52b844acbe60b4974e5a4ffc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:10.078067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7026acdb52b844acbe60b4974e5a4ffc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:10.138069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 832/1658] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:09 2022] DELETE /identity/v3/users/7026acdb52b844acbe60b4974e5a4ffc => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:10.142855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7342-fd15-4dcb-9902-34dc6dd4e20c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:10.144099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7342-fd15-4dcb-9902-34dc6dd4e20c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:10.144697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7342-fd15-4dcb-9902-34dc6dd4e20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:10.173286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9fbe7342-fd15-4dcb-9902-34dc6dd4e20c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:10.175054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9fbe7342-fd15-4dcb-9902-34dc6dd4e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:10.274732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 827/1659] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:10.308426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:10.309977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:10.405465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd2065-c303-41ed-8d63-c745d0771f78 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:10.410301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:10.411016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:10.411310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:10.411634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:10.430977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:10.433145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682f76f-b530-4847-a073-9b5caf5ddac9 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:10.447851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 833/1660] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:10.960947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:10.961269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:10.961514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:10.963645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 828/1661] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:11.003109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282de7e-7c2d-4193-b268-1d8690f88493 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.004523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282de7e-7c2d-4193-b268-1d8690f88493 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.004983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282de7e-7c2d-4193-b268-1d8690f88493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.049042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.054076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.065766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4282de7e-7c2d-4193-b268-1d8690f88493 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:11.067039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4282de7e-7c2d-4193-b268-1d8690f88493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.086115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebdb88-3d16-4c88-b0da-e6ddadbc2a24 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.091982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.093546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.093876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.094159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] PATH_INFO: `/v3/projects/c61fef70cdf14c87b50dbeb35927ab08` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.095400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61fef70cdf14c87b50dbeb35927ab08)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.100287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.145096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:11.183492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61fef70cdf14c87b50dbeb35927ab08', 'request_id': 'req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.200499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61fef70cdf14c87b50dbeb35927ab08', 'request_id': 'req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.201202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 834/1662] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:11.212397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61fef70cdf14c87b50dbeb35927ab08', 'request_id': 'req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.247818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dee1d-8920-45c9-8bc1-09c5bbc17535 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.248117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dee1d-8920-45c9-8bc1-09c5bbc17535 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.248378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dee1d-8920-45c9-8bc1-09c5bbc17535 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.249938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 835/1663] 10.222.0.23 () {54 vars in 960 bytes} [Mon Jun 20 14:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:52:11.254284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] The token cache is being invalidate because project c61fef70cdf14c87b50dbeb35927ab08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:11.254585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.258497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383afe-997c-418c-8f9f-53543dd04360 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.258657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383afe-997c-418c-8f9f-53543dd04360 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.259223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c383afe-997c-418c-8f9f-53543dd04360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.259754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d3a925b-6b76-4722-a4d8-7ee2f51466cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.282559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 829/1664] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:11 2022] DELETE /identity/v3/projects/c61fef70cdf14c87b50dbeb35927ab08 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:11.282559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.283502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.284342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.286807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-0c383afe-997c-418c-8f9f-53543dd04360 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:11.288155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0c383afe-997c-418c-8f9f-53543dd04360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.380630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] MFA Rules not processed for user `87c3f39c0bed4fadbc8a556c857baf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:11.383168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.442805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 836/1665] 10.222.0.23 () {58 vars in 1057 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:11.444198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.444501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.447302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.460213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:11.497528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:11.503613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.571166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 830/1666] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:11.593152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.612654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4b768-b835-48b8-96e5-4a5dd11b1d0d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.620984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.621746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.622102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.622554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.624753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.642031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.650143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 837/1667] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:11.650313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b53b8-57f4-4bbf-98ba-216199eed602 service placement] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.650387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.654636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.659850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 831/1668] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:11.665621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79596-255a-4779-80c3-203425d89628 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.665919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79596-255a-4779-80c3-203425d89628 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.666448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea79596-255a-4779-80c3-203425d89628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.693174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-eea79596-255a-4779-80c3-203425d89628 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:11.694582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-eea79596-255a-4779-80c3-203425d89628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.712225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 832/1669] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:11.717910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79596-255a-4779-80c3-203425d89628 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.729871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea79596-255a-4779-80c3-203425d89628 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.742085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.742085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.742085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.742085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.743013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:11.743013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.743013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.770673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515dc52-2409-4a7a-81e9-afc166ad0733 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.771266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 833/1670] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:11.772324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.775688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:11.779199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.780085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.783578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.784051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.799070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:11.801845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.802728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa37f4-34ff-4ba5-a220-09a27fea92d7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.806033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.810942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.812398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.812948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.813425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] PATH_INFO: `/v3/projects/d707620ca5d640f78d1a8d5cf64358e2` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.816093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d707620ca5d640f78d1a8d5cf64358e2)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.833422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 838/1671] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:11.833422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.837352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.845686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6dc966-6121-4da9-aa3b-29d7434e8728 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:11.851002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:11.851617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.852334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.852334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:11.852865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:11.855312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:11.890933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 839/1672] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:11.892255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:11.916004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd707620ca5d640f78d1a8d5cf64358e2', 'request_id': 'req-cee3cf31-26f9-4144-91d9-7a6a0c581668'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.924154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd707620ca5d640f78d1a8d5cf64358e2', 'request_id': 'req-cee3cf31-26f9-4144-91d9-7a6a0c581668'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.937258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd707620ca5d640f78d1a8d5cf64358e2', 'request_id': 'req-cee3cf31-26f9-4144-91d9-7a6a0c581668'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.959989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] The token cache is being invalidate because project d707620ca5d640f78d1a8d5cf64358e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:11.960482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.970052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cee3cf31-26f9-4144-91d9-7a6a0c581668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:11.971444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 834/1673] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:11 2022] DELETE /identity/v3/projects/d707620ca5d640f78d1a8d5cf64358e2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:11.976234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e244e0-1869-477d-ab6d-da3879d3de96 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:11.976586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e244e0-1869-477d-ab6d-da3879d3de96 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:11.976890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e244e0-1869-477d-ab6d-da3879d3de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.007090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-88e244e0-1869-477d-ab6d-da3879d3de96 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:12.015128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-88e244e0-1869-477d-ab6d-da3879d3de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.082175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc80dfc-2d4d-400d-b4bd-21037576ef53 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.202577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 835/1674] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:12.210495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.211594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.212135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.245102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.245902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.247228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.247519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.248231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.255372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.267986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:12.272635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.300449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 840/1675] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:11 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:12.302932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 836/1676] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:12.307842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.308927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.315591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.329973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077584-f26c-45f5-996b-e8850b262024 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.338710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a6efe-f3c0-40b3-9bc0-cf81ca7be5b1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.340313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.341112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.342562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.342894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.344670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:12.345635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.350134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.350891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.352908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.353261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.353671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.355663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.361589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.370221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:12.379264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 837/1677] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:12.385760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.393090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 841/1678] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:12.394182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.404892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334b0b2-fa84-41d0-9880-d96d69a7ba96 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.414330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f182e1b-a1a5-4b1f-a446-301fe34ba67f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.416741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.419013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.419803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.421126 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.422876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.430934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.431829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.432706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.434989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.435358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.436312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.439485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a5fc4-777c-4e42-bf18-342786e45c8f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.470077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 842/1679] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:12.470077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.470077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.470077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.491244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 838/1680] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:12.491244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.531919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] MFA Rules not processed for user `afc8379be09748a68ade6af9b99cdfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:12.534907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.630200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:12.638284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315ad18-5f8d-44fe-ab39-c2149beb2ae1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.648737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.650041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.650489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.651106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] PATH_INFO: `/v3/projects/19a1d871a5634b828a4dfa753e88fe78/users/242e4fc5a9e944b6986fc393952cc3d1/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.676218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a1d871a5634b828a4dfa753e88fe78, user_id=242e4fc5a9e944b6986fc393952cc3d1, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.689557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb697035-64d5-4776-b595-5b41604440ba admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.690685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 843/1681] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:12.692275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.710432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca72c-4a36-4851-9870-c7c8b1cc4a7f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.712665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 839/1682] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:12 2022] PUT /identity/v3/projects/19a1d871a5634b828a4dfa753e88fe78/users/242e4fc5a9e944b6986fc393952cc3d1/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:12.723027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.723027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.723027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.760414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] MFA Rules not processed for user `afc8379be09748a68ade6af9b99cdfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:12.766193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.809496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.810385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.810608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.812204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.813608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.819349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fb31-3c87-4a28-a152-41813facbb55 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.862305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 844/1683] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:12.864791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.865090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.865370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.907462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 840/1684] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:12.911237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.931765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd130e7a-692c-42d5-8e66-15e35a9b83cc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:12.937353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:12.938551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:12.939724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:12.941283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:12.942979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:12.948127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:12.949369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] MFA Rules not processed for user `242e4fc5a9e944b6986fc393952cc3d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:12.952865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:12.973118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 841/1685] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:12.981780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:12.987645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:13.103477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:13.136866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d7153-db17-443b-87d8-45ce31a5693b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.139267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 845/1686] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:13.140702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.162712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.164906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.165490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.165824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.173456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2f306-cba3-42bd-89df-4d50311c1a48 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.177370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.179145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.184456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.185461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.185884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.186295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.187353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.192117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 842/1687] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:13.192321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.193015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.207509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfcc62-0f6f-48e6-8564-28504482ca16 service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.215351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 846/1688] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:13.219312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.220606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.222274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.223502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.225442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.225442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.232065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.278377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a88286-94e2-41f4-b9d0-8ccc2fc21f62 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.307065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.307258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 843/1689] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:13 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:13.308144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.308864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.309444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.309943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] PATH_INFO: `/v3/projects/2aadab51044448338a3098786e2d034b/users/12ea5e9097604342864837dc7da961fc/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.335053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aadab51044448338a3098786e2d034b, user_id=12ea5e9097604342864837dc7da961fc, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.366675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763143f-00c9-4925-88b5-0b0b1ad16be4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.398541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 847/1690] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:13 2022] PUT /identity/v3/projects/2aadab51044448338a3098786e2d034b/users/12ea5e9097604342864837dc7da961fc/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:13.409332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.409630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.409914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.497424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad8920-c0a0-4bfa-878f-a8911c4883d7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.523645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] MFA Rules not processed for user `12ea5e9097604342864837dc7da961fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:13.525998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:13.553515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:13.619624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.622703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.623851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.624203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.626281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.634912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.692803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 844/1691] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:13 2022] POST /identity/v3/users => generated 294 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:13.693740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.697303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:13.721868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7dde9-ade2-4e5f-a4b4-17ae12713839 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.747097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.752084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.752342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.752630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] PATH_INFO: `/v3/users/95d9ab41801744e78c956b2a9fddd773` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.754100 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d9ab41801744e78c956b2a9fddd773)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.756095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.762785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 848/1692] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:13.763798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.790799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a60cce-70a6-4b68-b244-4c785d3e5dd9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.808898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.809604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.809991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.810255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.811007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.812640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.830201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 849/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:13.830914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:13.855542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d91f3-5450-4642-b96f-3b45e8fed4e3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:13.867751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d9ab41801744e78c956b2a9fddd773'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:13.869129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d9ab41801744e78c956b2a9fddd773'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:13.870759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:13.870759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:13.870759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:13.871038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:13.871385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d9ab41801744e78c956b2a9fddd773'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:13.874283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:13.875754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:13.878806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fd1b5-17bc-4905-a8f5-4d12b46674c1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:13.897766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d9ab41801744e78c956b2a9fddd773'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:13.948307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d9ab41801744e78c956b2a9fddd773'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:13.992164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 845/1694] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:13 2022] DELETE /identity/v3/users/95d9ab41801744e78c956b2a9fddd773 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:13.995438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.000687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:14.014359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 850/1695] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:13 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:14.016813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.017928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.018431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.067693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:14.070341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:14.177478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab8534-03e1-45c8-be9f-8a093dae0eb1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.261004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 851/1696] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:14.261916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.270455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:14.271599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.272691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.273064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.273469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.277370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.279197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.299278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 846/1697] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:14.300610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.311214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73085fe-c722-4a27-a0fa-8c70ad55dfae None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.316664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70a399-c3ce-48e0-b97e-cb4dbdcfc5f3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.324397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.325862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.326168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.326457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] PATH_INFO: `/v3/projects/a5c42300ec7e4250b5d2a08dcbaf2966/users/5aacc39c071e466a8d31c2aa9ba1234e/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.327322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.328095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.328382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.328656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.330117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.332366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.369509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c42300ec7e4250b5d2a08dcbaf2966, user_id=5aacc39c071e466a8d31c2aa9ba1234e, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.384701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.386474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 852/1698] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:14 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:14.393072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.426602 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1f8d7-f562-44e5-964c-c521cfe60572 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.439907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 847/1699] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:14 2022] PUT /identity/v3/projects/a5c42300ec7e4250b5d2a08dcbaf2966/users/5aacc39c071e466a8d31c2aa9ba1234e/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:14.450814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.450814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:14.607590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.608341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.609288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.609799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.617265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.620768 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9814c7-55b0-4f5d-8ae7-34adad63e237 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.628299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:14.663545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 853/1700] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:14.668069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.668373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.668660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.695886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:14.713683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1430b86-cb66-4283-8d22-0e00f0c448ee admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.727993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.728791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.729294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.729676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.741663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] MFA Rules not processed for user `5aacc39c071e466a8d31c2aa9ba1234e`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:14.743749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:14.760920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.762822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.799712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 848/1701] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:14.800861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:14.836400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee532b-2048-4cd4-9abf-68cd828db472 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:14.875838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:14.877077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:14.877450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:14.878427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] PATH_INFO: `/v3/projects/1f16eeababe349c882e43ca1169b072d/users/00288a12f8ba4da3999d3100e2b2e2bf/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:14.950537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f16eeababe349c882e43ca1169b072d, user_id=00288a12f8ba4da3999d3100e2b2e2bf, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:14.963284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:14.992319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 854/1702] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:14.997494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.012888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 849/1703] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:14 2022] PUT /identity/v3/projects/1f16eeababe349c882e43ca1169b072d/users/00288a12f8ba4da3999d3100e2b2e2bf/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:15.015560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18185-587e-4f23-8ec2-f4a60f40668c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.017672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.107900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.108992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.109565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.109850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.111000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.114010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da497-6612-4ce4-b081-af540d84ffd7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.129582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c77-7b5e-4516-8fe6-aaa044e1c586 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.153523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.154487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.154808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.158476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.158922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.160900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 855/1704] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:14 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:15.161928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.162349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24072-78f7-484d-b372-31c61fce3575 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.162644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24072-78f7-484d-b372-31c61fce3575 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.162918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b24072-78f7-484d-b372-31c61fce3575 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.164659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 856/1705] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:15.165177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b24072-78f7-484d-b372-31c61fce3575 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.183301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 850/1706] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:15.184344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.205805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc58431-5cc3-442f-96c2-be6050a81d00 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.264820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b24072-78f7-484d-b372-31c61fce3575 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.272923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.274008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.274714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.275194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.276208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.278807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c8d4d-c4d0-4f19-a9d9-31e5150faff5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.326242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 857/1707] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:15 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:15.328048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211f28-c4b8-40ae-90b0-518ca86b4b18 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.328553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211f28-c4b8-40ae-90b0-518ca86b4b18 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.329088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c211f28-c4b8-40ae-90b0-518ca86b4b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.341915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:15.366418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4c211f28-c4b8-40ae-90b0-518ca86b4b18 None None] MFA Rules not processed for user `1a352ef3c0df4e4ea94f3a76b96abb87`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:15.370517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4c211f28-c4b8-40ae-90b0-518ca86b4b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:15.424386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.435180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.435734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.437038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] PATH_INFO: `/v3/projects/1f16eeababe349c882e43ca1169b072d/users/00288a12f8ba4da3999d3100e2b2e2bf/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.444429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f16eeababe349c882e43ca1169b072d, user_id=00288a12f8ba4da3999d3100e2b2e2bf, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.450034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.480235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 851/1708] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:15 2022] PUT /identity/v3/projects/1f16eeababe349c882e43ca1169b072d/users/00288a12f8ba4da3999d3100e2b2e2bf/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:15.490275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.579941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 858/1709] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:15.587188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008e4d-9a94-40ea-b691-249c750ca174 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.592657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008e4d-9a94-40ea-b691-249c750ca174 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.593118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5008e4d-9a94-40ea-b691-249c750ca174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.678770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:15.695190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66732b7d-e981-47df-849a-31f1c97014b9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.710857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.711429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.711710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.711986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.716395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.717303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e5008e4d-9a94-40ea-b691-249c750ca174 None None] MFA Rules not processed for user `00288a12f8ba4da3999d3100e2b2e2bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:15.718884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e5008e4d-9a94-40ea-b691-249c750ca174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:15.722032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.758669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 852/1710] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:15.759155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:15.766641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:15.796923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8740-d1e6-4404-ba3d-76ccf0bde69a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:15.810226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:15.811139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.811419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.811693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] PATH_INFO: `/v3/users/833d253218454d7d8994c1141cb19a6c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.815587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=833d253218454d7d8994c1141cb19a6c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:15.822225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:15.944417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '833d253218454d7d8994c1141cb19a6c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:15.947008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '833d253218454d7d8994c1141cb19a6c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:15.948284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '833d253218454d7d8994c1141cb19a6c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:15.966468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '833d253218454d7d8994c1141cb19a6c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:15.983347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 859/1711] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:15.989959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:15.990470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:15.990766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:15.994844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 860/1712] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jun 20 14:52:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:16.003269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.006503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '833d253218454d7d8994c1141cb19a6c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:16.018870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.042998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 853/1713] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:15 2022] DELETE /identity/v3/users/833d253218454d7d8994c1141cb19a6c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:16.045240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.047905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.194232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06eb0e-b583-4fcb-bc37-c92546fe10e9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:16.205193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:16.206207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.206490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.206766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] PATH_INFO: `/v3/projects/46d09f10696b410a8f7581f851837b03/users/263c0f5571ed42bead4fc5804cb253b0/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.227380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d09f10696b410a8f7581f851837b03, user_id=263c0f5571ed42bead4fc5804cb253b0, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:16.232527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:16.251949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045f9c-9cf8-48e9-8935-e50102ad9ef5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:16.269632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 854/1714] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:16 2022] PUT /identity/v3/projects/46d09f10696b410a8f7581f851837b03/users/263c0f5571ed42bead4fc5804cb253b0/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:16.271477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.275741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.330056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:16.383268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:16.392426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91b20-2abe-4fa2-bcbe-2e38b35d867b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:16.431434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:16.433119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.434692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.435143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.443539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.447934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:16.452733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.453399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.453996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.457719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.497966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:16.499807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef2203-1878-4bfb-bf40-c36c6495af7c service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:16.540380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 861/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:16.542733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247f11-14cb-434a-87ac-fba8790b9875 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.543503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247f11-14cb-434a-87ac-fba8790b9875 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.544992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b247f11-14cb-434a-87ac-fba8790b9875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.648602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:16.650346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:16.656798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3b247f11-14cb-434a-87ac-fba8790b9875 None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:16.658193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3b247f11-14cb-434a-87ac-fba8790b9875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.687858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 855/1716] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:16.689731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.835742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 862/1717] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:16.840054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.840732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.841156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.862461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20570f-5829-4014-beec-ef0b2d8c9475 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:16.868203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:16.869124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.869599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.870048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.871039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:16.873292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:16.876938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] MFA Rules not processed for user `87c3f39c0bed4fadbc8a556c857baf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:16.878427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.889139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 856/1718] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:16.890243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.892950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:16.909727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ae7b2c-4d63-4c16-82ab-910188ddf781 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:16.915059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:16.916269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:16.917850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:16.918274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] PATH_INFO: `/v3/users/edf609dc8c5e4cf8a9f534153858cbc8` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:16.919760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edf609dc8c5e4cf8a9f534153858cbc8)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:16.921904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:16.958564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 863/1719] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:16.959262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:16.966665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.000392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e6159e-5605-4a85-9e09-32d58319c414 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:17.016456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:17.017391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.017674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.018179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] PATH_INFO: `/v3/projects/a1b38d95652c4cdaa5b84dd9e0d3d644` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.019745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b38d95652c4cdaa5b84dd9e0d3d644)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:17.023382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: WARNING py.warnings [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 20 14:52:17.023382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: warnings.warn(msg) Jun 20 14:52:17.023382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: Jun 20 14:52:17.024665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:17.031367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edf609dc8c5e4cf8a9f534153858cbc8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.035847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edf609dc8c5e4cf8a9f534153858cbc8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.037811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edf609dc8c5e4cf8a9f534153858cbc8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.055172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edf609dc8c5e4cf8a9f534153858cbc8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.077996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edf609dc8c5e4cf8a9f534153858cbc8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.128584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 857/1720] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:16 2022] DELETE /identity/v3/users/edf609dc8c5e4cf8a9f534153858cbc8 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:17.129755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:17.131944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.144794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:17.185768 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b38d95652c4cdaa5b84dd9e0d3d644', 'request_id': 'req-4ee90fd3-544b-46ca-95e0-af1085d5a04e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.207199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:17.218845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b38d95652c4cdaa5b84dd9e0d3d644', 'request_id': 'req-4ee90fd3-544b-46ca-95e0-af1085d5a04e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.230744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b38d95652c4cdaa5b84dd9e0d3d644', 'request_id': 'req-4ee90fd3-544b-46ca-95e0-af1085d5a04e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.256020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] The token cache is being invalidate because project a1b38d95652c4cdaa5b84dd9e0d3d644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:17.256419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.257510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.260147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 864/1721] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:16 2022] DELETE /identity/v3/projects/a1b38d95652c4cdaa5b84dd9e0d3d644 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:17.261423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:17.264092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.297588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ade058-3cec-4d61-b3a0-3406b3df56f5 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:17.303069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:17.304353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.304872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.305301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] PATH_INFO: `/v3/projects/bd09d185eb7f41999e0373a3d701d5e4` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.307022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd09d185eb7f41999e0373a3d701d5e4)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:17.309474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:17.349633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90fd3-544b-46ca-95e0-af1085d5a04e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:17.378875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd09d185eb7f41999e0373a3d701d5e4', 'request_id': 'req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.395839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd09d185eb7f41999e0373a3d701d5e4', 'request_id': 'req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.404757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd09d185eb7f41999e0373a3d701d5e4', 'request_id': 'req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.432880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] The token cache is being invalidate because project bd09d185eb7f41999e0373a3d701d5e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:17.433559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.433886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:17.440617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 858/1722] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:17 2022] DELETE /identity/v3/projects/bd09d185eb7f41999e0373a3d701d5e4 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:17.441879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:17.443607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.458886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:17.459570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.459861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.460134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.466045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.578309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:17.579772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:17.599355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ceca7-81e1-4c24-83c5-104a3f4c49b4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:17.602542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 865/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:17.603355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:17.603493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:17.604114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.604398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.604667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.607966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.613602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.634039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:17.636063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd9e1f-e2fa-4f70-8752-6275742c25f6 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:17.641619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03743e-7592-457d-ab00-71635ca18553 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:17.658590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 859/1724] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:17.660242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320880-e454-4bd8-a274-0d8c6e735cc2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.660798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320880-e454-4bd8-a274-0d8c6e735cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.661234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2320880-e454-4bd8-a274-0d8c6e735cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.712532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e2320880-e454-4bd8-a274-0d8c6e735cc2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:17.713835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e2320880-e454-4bd8-a274-0d8c6e735cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.792807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:17.820438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:17.821790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.821949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.822223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] PATH_INFO: `/v3/projects/46d09f10696b410a8f7581f851837b03/users/263c0f5571ed42bead4fc5804cb253b0/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.840840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d09f10696b410a8f7581f851837b03, user_id=263c0f5571ed42bead4fc5804cb253b0, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:17.848285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:17.849314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:17.903364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 866/1725] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:17 2022] PUT /identity/v3/projects/46d09f10696b410a8f7581f851837b03/users/263c0f5571ed42bead4fc5804cb253b0/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:17.904426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:17.913799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 860/1726] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:17.914012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:17.914102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273514-3403-4c49-889b-3ba30108c5f6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:17.914102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273514-3403-4c49-889b-3ba30108c5f6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:17.914102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273514-3403-4c49-889b-3ba30108c5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:17.948499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8f273514-3403-4c49-889b-3ba30108c5f6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:17.949854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8f273514-3403-4c49-889b-3ba30108c5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.092104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 861/1727] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:18.093803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.095574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.096060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.159303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] MFA Rules not processed for user `263c0f5571ed42bead4fc5804cb253b0`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:18.161671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47bfed-ac4c-4984-9501-169f4195149e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:18.165322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.181245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:18.184349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.184635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.196161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] PATH_INFO: `/v3/users/04e9499d796d420d8518217aa322f3ce` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.199179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e9499d796d420d8518217aa322f3ce)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:18.206379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:18.302693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e9499d796d420d8518217aa322f3ce'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:18.303645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e9499d796d420d8518217aa322f3ce'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:18.330379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e9499d796d420d8518217aa322f3ce'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:18.341347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e9499d796d420d8518217aa322f3ce'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:18.345787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-00711f62-f972-4257-9bf9-8e41792b729e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e9499d796d420d8518217aa322f3ce'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:18.372808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 862/1728] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:18.372808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:18.377262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.393154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 867/1729] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:17 2022] DELETE /identity/v3/users/04e9499d796d420d8518217aa322f3ce => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:18.394636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4006-aa68-4b82-9446-f853b99d3216 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.395031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4006-aa68-4b82-9446-f853b99d3216 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.395219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c4006-aa68-4b82-9446-f853b99d3216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.467474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3c8c4006-aa68-4b82-9446-f853b99d3216 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:18.468772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3c8c4006-aa68-4b82-9446-f853b99d3216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.537035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f66abe-ba98-41cc-b78c-f732a94eda79 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:18.599573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:18.661381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 868/1730] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:18.662780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.663073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.663355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.675660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 869/1731] 10.222.0.23 () {54 vars in 912 bytes} [Mon Jun 20 14:52:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:18.676642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:18.683679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.689734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:18.690328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.690734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.691923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.696855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.700487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:18.721660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:18.723270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:18.761996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 863/1732] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:18.764053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:18.806735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b538d5c0-1f1b-4563-a701-7794e4b00885 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:18.820836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:18.823622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.824183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.824415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.825456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:18.825828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:18.833169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330988ea-6b97-4186-96c4-59483c0a77a3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:18.835843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeda224-0500-4290-bb74-30959fc85c61 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:18.853896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:18.854886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.858126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.859690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.869009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.880405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 864/1733] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:18.882568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd54-a27c-45bb-a475-629c3a1a6815 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.889161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd54-a27c-45bb-a475-629c3a1a6815 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.889403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd54-a27c-45bb-a475-629c3a1a6815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:18.940138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ae9cfd54-a27c-45bb-a475-629c3a1a6815 None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:18.941576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ae9cfd54-a27c-45bb-a475-629c3a1a6815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:18.965217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 865/1734] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:18.982012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:18.982362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:18.982710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.066236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] MFA Rules not processed for user `75ebe0d05a1c4b66aa3b3abebd0ce026`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:19.072215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:19.078725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:19.080651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:19.106040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 870/1735] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:19.110464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.130175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815b40a-6ffe-4b37-a5d1-816b1b1ce54e service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:19.137343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:19.137973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:19.138317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:19.138617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.139759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:19.141755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:19.225532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 866/1736] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:19.225987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.227715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:19.264661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c462-4e19-4f71-9702-dade5ac0d8d0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:19.265584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 871/1737] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:19 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:19.267973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.276612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:19.383311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:19.384205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:19.384556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:19.385349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.396566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:19.398584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c7b62-f3dd-48a7-bf14-8ae974955bd7 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:19.408814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 867/1738] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:19.417906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:19.418210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:19.418484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.495797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] MFA Rules not processed for user `75ebe0d05a1c4b66aa3b3abebd0ce026`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:19.502519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:19.553353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034146c4-36f1-441b-83c8-245e375fd799 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:19.622660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:19.627129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:19.628625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:19.629163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:19.629644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] PATH_INFO: `/v3/projects/87cf38422d7e4368b24b270f13e9629d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.638410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87cf38422d7e4368b24b270f13e9629d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:19.639689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:19.696866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 868/1739] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:19.699435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.738741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598c52f-a6c8-4e3d-a5b9-ba7207389f51 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:19.757664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:19.759261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:19.760500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:19.761011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:19.761988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:19.765149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:19.782282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:19.807680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87cf38422d7e4368b24b270f13e9629d', 'request_id': 'req-5af19bc0-c07b-4199-a010-c96917328568'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:19.814205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 869/1740] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:19 2022] POST /identity/v3/users => generated 285 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:19.825185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87cf38422d7e4368b24b270f13e9629d', 'request_id': 'req-5af19bc0-c07b-4199-a010-c96917328568'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:19.825773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.831222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:19.844238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87cf38422d7e4368b24b270f13e9629d', 'request_id': 'req-5af19bc0-c07b-4199-a010-c96917328568'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:19.879438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] The token cache is being invalidate because project 87cf38422d7e4368b24b270f13e9629d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:19.879438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:19.885518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:19.889066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 872/1741] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:19 2022] DELETE /identity/v3/projects/87cf38422d7e4368b24b270f13e9629d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:19.889572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:19.895893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.089849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870ffce-73bc-4a59-83f2-e7c2f740ecda admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:20.123305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af19bc0-c07b-4199-a010-c96917328568 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:20.147675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:20.148818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.149280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.149679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] PATH_INFO: `/v3/projects/78627db930574b51b53a4f8447056630` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:20.153814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78627db930574b51b53a4f8447056630)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:20.155534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:20.291346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:20.293390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.294661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.295046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:20.305686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.318690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78627db930574b51b53a4f8447056630', 'request_id': 'req-9701df6d-a11e-4e41-9859-42b454f833c9'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:20.329335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78627db930574b51b53a4f8447056630', 'request_id': 'req-9701df6d-a11e-4e41-9859-42b454f833c9'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:20.344189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78627db930574b51b53a4f8447056630', 'request_id': 'req-9701df6d-a11e-4e41-9859-42b454f833c9'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:20.347270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:20.352643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:20.366162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] The token cache is being invalidate because project 78627db930574b51b53a4f8447056630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:20.366465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:20.369734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9701df6d-a11e-4e41-9859-42b454f833c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:20.379955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 873/1742] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:19 2022] DELETE /identity/v3/projects/78627db930574b51b53a4f8447056630 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:20.379955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.379955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.379955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:20.392688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 870/1743] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:20.397260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:20.403300 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.490205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] MFA Rules not processed for user `afc8379be09748a68ade6af9b99cdfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:20.491487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.578982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:20.653927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa2edc-8c3c-41d7-9d2f-cc5f9534e9ff service placement] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:20.704265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:20.739295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 874/1744] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:20.740804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:20.745795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.863290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:20.865370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.866127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.866127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:20.871440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:20.921265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00c7bb-f83c-4901-b283-10bcc14b8d54 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:20.935694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:20.936865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.937243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.937613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:20.938458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:20.942732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09eb054-ae0a-45fd-8d5f-ecee8d075dff admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:20.966536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 875/1745] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:20.968231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129120-6729-4fca-8529-12ec85cd323e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:20.970452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129120-6729-4fca-8529-12ec85cd323e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:20.971310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56129120-6729-4fca-8529-12ec85cd323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.013965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.015880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.018723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-56129120-6729-4fca-8529-12ec85cd323e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:21.026345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-56129120-6729-4fca-8529-12ec85cd323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.040978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 871/1746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:21.049523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 876/1747] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:21.050821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129120-6729-4fca-8529-12ec85cd323e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.052887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-56129120-6729-4fca-8529-12ec85cd323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.060608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.068693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.107175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5a38c-4a64-4d41-bc4e-d237e65a0f67 service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.139504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.140465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.140735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.145601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] PATH_INFO: `/v3/users/54b99aab9603432aa7d4f1c2f73bcc93` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.150108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b99aab9603432aa7d4f1c2f73bcc93)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.159582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.229664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56129120-6729-4fca-8529-12ec85cd323e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.243762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.246246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.246246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.249293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.260528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.319189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b99aab9603432aa7d4f1c2f73bcc93'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:21.322921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b99aab9603432aa7d4f1c2f73bcc93'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:21.323986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b99aab9603432aa7d4f1c2f73bcc93'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:21.352268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b99aab9603432aa7d4f1c2f73bcc93'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:21.418424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b99aab9603432aa7d4f1c2f73bcc93'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:21.452442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 872/1748] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:21 2022] DELETE /identity/v3/users/54b99aab9603432aa7d4f1c2f73bcc93 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:21.454271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.461154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.467795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.469514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f82ab-87fd-41fd-bdd9-85b2117ee0ca service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.475505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:21.503837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 877/1749] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:21.521083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.523738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.524665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.582895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:21.586641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:21.694247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:21.737555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f258d641-5a16-4122-aa07-4d24c48d217c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.762641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.771190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 878/1750] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:21.772658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.774989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.775289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.775570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.776359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.793161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.812459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8eb5e-7441-4b27-aea5-edd815dddaf2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.823797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.826160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.826448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.827355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.830227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:21.830227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.835402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.874108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 873/1751] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:21.875164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.878895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 879/1752] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:21.880239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:21.914543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256c6e3-ed91-47d6-bc44-5949e8ce1349 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.917300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46c0fa-8a44-4ddc-9639-8927fb88eff3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:21.932223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.933726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.936059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.936471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:21.938290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:21.946102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:21.952786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:21.955835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:21.956125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:21.956410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] PATH_INFO: `/v3/projects/dcad324a672a462e951dcdce5b62dc5b/users/545933a87e6a4993afaa6528b86e327e/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.016798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcad324a672a462e951dcdce5b62dc5b, user_id=545933a87e6a4993afaa6528b86e327e, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:22.020113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f07c5f-337b-4ea2-9b8a-da64286a38c7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:22.047484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 880/1753] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:21 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:22.052763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:22.060814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 874/1754] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:21 2022] PUT /identity/v3/projects/dcad324a672a462e951dcdce5b62dc5b/users/545933a87e6a4993afaa6528b86e327e/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:22.074744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.075243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.075660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.180744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] MFA Rules not processed for user `545933a87e6a4993afaa6528b86e327e`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:22.192843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:22.247145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2582351-ced8-46cb-a400-459dd0a5859a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:22.412149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:22.412894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.413186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.413448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.414222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:22.416166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:22.454849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 875/1755] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:22.483980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 881/1756] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:22 2022] POST /identity/v3/users => generated 282 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:22.487835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:22.512746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e820475-c2f9-4a57-b953-0e0967824fd3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:22.531242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:22.532097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.532486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.532898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.533827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:22.535615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:22.588093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 876/1757] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:22.592010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:22.612051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487de2e7-dba5-462f-a28a-3ccb688ccd4d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:22.622834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:22.623636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.625173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.625561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.626514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:22.632708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d626c-7b53-45db-b9e9-5c272218a7c8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:22.677227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 882/1758] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:22.681193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:22.696110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c359963-053e-4447-93e8-0d990997da77 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:22.719330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:22.720533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.721083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.721590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] PATH_INFO: `/v3/projects/7480d0d6ee004f09bf7655ad3631d943/users/15a60bd3dea34b099e9186b11565cb06/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.765905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7480d0d6ee004f09bf7655ad3631d943, user_id=15a60bd3dea34b099e9186b11565cb06, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:22.768991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:22.796853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 877/1759] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:22 2022] PUT /identity/v3/projects/7480d0d6ee004f09bf7655ad3631d943/users/15a60bd3dea34b099e9186b11565cb06/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:22.803360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:22.803867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:22.804087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:22.883649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] MFA Rules not processed for user `15a60bd3dea34b099e9186b11565cb06`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:22.886668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:22.935013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:23.067854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.071555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 883/1760] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:23.147795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:23.215746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.217545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:23.225149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8e7b3-f67b-49be-85ee-0a089243730c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.255410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:23.256827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:23.257379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:23.257874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:23.259310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:23.261613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:23.311012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 878/1761] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:23 2022] POST /identity/v3/projects => generated 365 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:23.318281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.422230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bff214-c6d7-44af-83ef-6183efff91b8 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.522735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd41ea-a831-4547-9774-203da7f61f22 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.530417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:23.531373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:23.532174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:23.533535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:23.534438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:23.536990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:23.590141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 879/1762] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:23 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:23.591548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.594782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:23.640298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4dbeb1-650e-4cd4-9fec-2527c8a4c7af admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.651329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:23.651946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:23.653043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:23.653437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:23.653678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] PATH_INFO: `/v3/users/12ea5e9097604342864837dc7da961fc` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:23.654723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:23.655202 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ea5e9097604342864837dc7da961fc)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:23.655593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:23.656048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:23.658319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:23.793909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:23.797043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:23.801890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:23.813523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 884/1763] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:23.815749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.846143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe51784-1b85-42a5-bec1-47c37a03f558 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.863187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:23.863787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ea5e9097604342864837dc7da961fc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:23.865324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ea5e9097604342864837dc7da961fc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:23.868359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:23.870503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ea5e9097604342864837dc7da961fc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:23.870742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:23.870742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:23.872210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:23.878244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:23.888630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ea5e9097604342864837dc7da961fc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:23.913430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 885/1764] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:23.914705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.920844 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ea5e9097604342864837dc7da961fc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:23.926041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:23.970665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04e360-fd0b-49c6-89d7-5f979caf6983 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:23.974336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 880/1765] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:23 2022] DELETE /identity/v3/users/12ea5e9097604342864837dc7da961fc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:23.979283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:23.984233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:24.087854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:24.218978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:24.220221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.220508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.220813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] PATH_INFO: `/v3/projects/91c24c4c26324fc585121efee9d4f902` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.225497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c24c4c26324fc585121efee9d4f902)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:24.233460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:24.394890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9898150-73bf-4442-8418-8f60cd90f544 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:24.397790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c24c4c26324fc585121efee9d4f902', 'request_id': 'req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:24.409061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c24c4c26324fc585121efee9d4f902', 'request_id': 'req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:24.430756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c24c4c26324fc585121efee9d4f902', 'request_id': 'req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:24.456701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] The token cache is being invalidate because project 91c24c4c26324fc585121efee9d4f902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:24.456701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:24.462345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-5a6ec013-aff0-4fa3-8ce5-91066f2b8688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:24.465374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 886/1766] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:23 2022] DELETE /identity/v3/projects/91c24c4c26324fc585121efee9d4f902 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:24.466845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093054a-2512-4f26-80c3-51fecc07a8c1 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.467204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093054a-2512-4f26-80c3-51fecc07a8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.467551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093054a-2512-4f26-80c3-51fecc07a8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.526062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2093054a-2512-4f26-80c3-51fecc07a8c1 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:24.527607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2093054a-2512-4f26-80c3-51fecc07a8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:24.603658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:24.607732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.608917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.609254 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] PATH_INFO: `/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f/users/0fadbdd9583242bda583e70dde88c0cc/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.653940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e4e7cd3b6047c5b481a3eb1719e74f, user_id=0fadbdd9583242bda583e70dde88c0cc, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:24.667130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:24.708808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 881/1767] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:23 2022] PUT /identity/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f/users/0fadbdd9583242bda583e70dde88c0cc/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:24.710316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:24.714818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:24.729967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 887/1768] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:24.733286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.735737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.736594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.783158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:24.784581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:24.801249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:24.900126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 888/1769] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:24.901110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:24.911590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:24.925752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61eb50-8c9f-4041-a623-9e184607fc39 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:24.926368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d6d5e-72a0-451f-907d-ad295b54adcf None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:24.932837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:24.933646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.933927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.934196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.934944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:24.936884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:24.941927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:24.943087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:24.943387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:24.944059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] PATH_INFO: `/v3/users/545933a87e6a4993afaa6528b86e327e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:24.946160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545933a87e6a4993afaa6528b86e327e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:24.948980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:24.951153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 889/1770] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:24.952147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:24.958212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.024404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545933a87e6a4993afaa6528b86e327e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:25.025613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545933a87e6a4993afaa6528b86e327e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:25.026577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545933a87e6a4993afaa6528b86e327e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:25.029729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:25.066058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545933a87e6a4993afaa6528b86e327e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:25.083505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba305fe1-db86-4b3c-bd8e-ffdd8033ccac admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:25.086235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d86e2a1-ec2b-4536-86d5-88899c203ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545933a87e6a4993afaa6528b86e327e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:25.088289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:25.089549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.089982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.090256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.094067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.126984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:25.129473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:25.139156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 882/1771] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:24 2022] DELETE /identity/v3/users/545933a87e6a4993afaa6528b86e327e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:25.145194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0023-fc64-4be5-998f-6ad111fe8401 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.145482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0023-fc64-4be5-998f-6ad111fe8401 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.145761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a0023-fc64-4be5-998f-6ad111fe8401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.149260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 890/1772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:25.150164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:25.151560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.172169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b0c0-a63f-4544-b79f-73a5d780cd05 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:25.185698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-393a0023-fc64-4be5-998f-6ad111fe8401 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:25.187092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-393a0023-fc64-4be5-998f-6ad111fe8401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.251917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:25.254150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.254150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.254360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] PATH_INFO: `/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f/users/0fadbdd9583242bda583e70dde88c0cc/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.258141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e4e7cd3b6047c5b481a3eb1719e74f, user_id=0fadbdd9583242bda583e70dde88c0cc, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:25.263130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710012db-5156-4f81-856a-1ce18303c6f4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:25.312840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 891/1773] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:25 2022] PUT /identity/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f/users/0fadbdd9583242bda583e70dde88c0cc/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:25.312840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc30c0-9830-426e-be30-a5cf4ae815d2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.312840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc30c0-9830-426e-be30-a5cf4ae815d2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.312840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc30c0-9830-426e-be30-a5cf4ae815d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.399295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 883/1774] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:25.403116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.403477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.403858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.405906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bcdc30c0-9830-426e-be30-a5cf4ae815d2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:25.408031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bcdc30c0-9830-426e-be30-a5cf4ae815d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.478447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:25.479851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.497628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:25.553127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 892/1775] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:25.557770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.558072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.558359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.630377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] MFA Rules not processed for user `0fadbdd9583242bda583e70dde88c0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:25.633725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.689488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 884/1776] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:25.690390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:25.728867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97649c6-c540-4908-aa00-2847cf6b089d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:25.746211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:25.746918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.747207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.747489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.748256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:25.748547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:25.761673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:25.815472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 893/1777] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:25.815472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:25.816971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.830648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 885/1778] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:25.831631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:25.838922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:25.908821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb0d73-93b4-443a-b864-c3c7dee22d5b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:25.916812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:25.918109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:25.918398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:25.918690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:25.987709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:25.993922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.037780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 894/1779] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:26.038908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.056137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44e4b9-1477-4778-8935-393b55ee61eb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.064577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.065324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.065788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.066138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.072593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4e6dd-48b8-429e-bb17-476ddc079cf0 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.078245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.079903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.087628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:26.094822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.098273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.100363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.100661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.103423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.106666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 886/1780] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:26.107710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.107882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.112375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:26.170838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 895/1781] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:26 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:26.175037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.299742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:26.313111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a5b0-06e0-494b-a83e-0120b8f60e7e service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.320076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332dc48a-5818-4dce-aaa1-efc36e6978e5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.326841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.328009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.328811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.329406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.330391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.332674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.388381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 896/1782] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:26 2022] POST /identity/v3/users => generated 282 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:26.391932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.445836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.446510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.446937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.447228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.492473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2ced-cb3a-4755-b9e0-cbaf795617f5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.498920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.499820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.500322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.501321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.503853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:26.526007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.527932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.541783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 887/1783] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:52:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:52:26.543308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.558519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffd01-7a67-4974-9850-3def6b744e0a service swift] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.568195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.570634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.571039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.571411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.572319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.574751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.592611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 888/1784] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:26.593988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.606203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798daf-87ec-47f6-8498-82af97878b8b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.612855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.613715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.614112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.614502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.615500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.618410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.637980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 889/1785] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:26.639424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.654052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be2ab2-9978-41e9-a79d-9b6213ef7729 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:26.667435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:26.668601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.669007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.669496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] PATH_INFO: `/v3/projects/7c53448566cc404b82ef1b4b5aa73875/users/1ef6974637414c9095f565477ca877fd/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.691992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.695428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83801c-4ae9-4467-9b40-9ef0d6062732 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.695572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c53448566cc404b82ef1b4b5aa73875, user_id=1ef6974637414c9095f565477ca877fd, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:26.698526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:26.713060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:26.721782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 897/1786] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:26 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:26.748924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 890/1787] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:26 2022] PUT /identity/v3/projects/7c53448566cc404b82ef1b4b5aa73875/users/1ef6974637414c9095f565477ca877fd/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:26.749399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:26.749941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:26.750229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:26.807989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] MFA Rules not processed for user `1ef6974637414c9095f565477ca877fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:26.809427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:26.965282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:26.983496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 898/1788] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:27.169716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e382d-1247-4813-a376-fe773bcf5320 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:27.184125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:27.184943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:27.185324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:27.185604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:27.187008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:27.189481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:27.311639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 891/1789] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:26 2022] POST /identity/v3/projects => generated 365 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:27.316772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:27.343381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf6b65-c374-48fd-9948-f3ab87be118d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:27.433038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:27.669457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:27.672985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:27.672985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:27.672985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:27.672985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:27.673569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:27.697061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:27.699577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:27.731582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 899/1790] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:27 2022] POST /identity/v3/users => generated 289 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:27.736187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:27.780503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd789f-c0ba-4ae5-8feb-020e08b4df12 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:27.787506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:27.788246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:27.789294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:27.792216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:27.802719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:27.806105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:27.823340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 900/1791] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:27.837434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:27.878424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89232533-c367-4783-b60d-b1688dc52903 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:27.886521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:27.888191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:27.888701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:27.889308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] PATH_INFO: `/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3/users/2d4db1a5c377444f809f0242ba38ac3b/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:27.904087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55663266-f6db-4a75-aa08-d1393166e239 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:27.909149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:27.913040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d02ca4298ed49bbb9f0831cf71a08f3, user_id=2d4db1a5c377444f809f0242ba38ac3b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:27.916384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:27.916801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:27.916934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:27.917106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:27.920469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:27.946951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 901/1792] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:27 2022] PUT /identity/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3/users/2d4db1a5c377444f809f0242ba38ac3b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:27.950208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:28.098641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:28.102127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:28.125355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 892/1793] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:28.134816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7647d16-46fc-417b-a7bf-2c42f49f9d35 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:28.165344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:28.166296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:28.166775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:28.167299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:28.168507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:28.171194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae8bf3-f70d-482f-9c0e-5315f1f7dda7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:28.208738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 902/1794] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:28.210018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:28.229435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4acd4b-9af3-49ca-b193-c719e6b31af6 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:28.253178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:28.254170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:28.254459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:28.254756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] PATH_INFO: `/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3/users/2d4db1a5c377444f809f0242ba38ac3b/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:28.255545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:28.256380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:28.256877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:28.267327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d02ca4298ed49bbb9f0831cf71a08f3, user_id=2d4db1a5c377444f809f0242ba38ac3b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:28.279505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250f68-b755-4b7d-add2-0ed33901e033 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:28.307549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:28.308832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:28.332874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 893/1795] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:28 2022] PUT /identity/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3/users/2d4db1a5c377444f809f0242ba38ac3b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:28.347925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:28.348897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:28.351094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:28.468513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] MFA Rules not processed for user `2d4db1a5c377444f809f0242ba38ac3b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:28.471815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:28.513751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:28.539555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 903/1796] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Jun 20 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:28.562511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:28.564539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:28.583433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e286c4-a695-4205-b599-16723bf16868 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:28.604092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:28.604981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:28.605272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:28.605741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:28.635343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:28.646785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:28.677398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 904/1797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:28.717558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 894/1798] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:28.776303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:28.818933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:29.041818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd65b-2542-40d3-91a0-d6b6527c5ab7 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:29.051164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:29.052022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:29.052424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:29.053094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:29.081481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:29.084479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:29.126399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 905/1799] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:29.669160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:29.669864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:29.856116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda94cd9-acc0-4b9f-99d8-a2c15ffa535c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:29.869246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:29.870404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:29.871269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:29.871751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] PATH_INFO: `/v3/projects/2aadab51044448338a3098786e2d034b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:29.879645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aadab51044448338a3098786e2d034b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:29.879645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:30.048681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aadab51044448338a3098786e2d034b', 'request_id': 'req-ec230643-5c86-459a-b25b-6c22933594dd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.061306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aadab51044448338a3098786e2d034b', 'request_id': 'req-ec230643-5c86-459a-b25b-6c22933594dd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.076018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aadab51044448338a3098786e2d034b', 'request_id': 'req-ec230643-5c86-459a-b25b-6c22933594dd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.130566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] The token cache is being invalidate because project 2aadab51044448338a3098786e2d034b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:30.131277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.132299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.135836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 895/1800] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:29 2022] DELETE /identity/v3/projects/2aadab51044448338a3098786e2d034b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:30.140028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:30.175803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79aa118-238e-4145-a3b2-b9f750807bcc service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:30.439259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:30.440139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:30.440410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:30.440677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] PATH_INFO: `/v3/users/00288a12f8ba4da3999d3100e2b2e2bf` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:30.448678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00288a12f8ba4da3999d3100e2b2e2bf)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:30.458687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:30.537570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:30.539584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:30.570090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec230643-5c86-459a-b25b-6c22933594dd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:30.578387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:30.579783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:30.581149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:30.581609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] PATH_INFO: `/v3/users/1ef6974637414c9095f565477ca877fd` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:30.584087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00288a12f8ba4da3999d3100e2b2e2bf'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.586306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00288a12f8ba4da3999d3100e2b2e2bf'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.604481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ef6974637414c9095f565477ca877fd)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:30.607395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:30.648791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00288a12f8ba4da3999d3100e2b2e2bf'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.674713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00288a12f8ba4da3999d3100e2b2e2bf'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.678207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:30.684288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00288a12f8ba4da3999d3100e2b2e2bf'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.711835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ef6974637414c9095f565477ca877fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.725993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ef6974637414c9095f565477ca877fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.726941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ef6974637414c9095f565477ca877fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.730927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 906/1801] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:30 2022] DELETE /identity/v3/users/00288a12f8ba4da3999d3100e2b2e2bf => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:30.732748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:30.734349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:30.741001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ef6974637414c9095f565477ca877fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.758814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d1a86fa0-7a5c-4cfe-95ce-f30afef025da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ef6974637414c9095f565477ca877fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:30.788839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 896/1802] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:30 2022] DELETE /identity/v3/users/1ef6974637414c9095f565477ca877fd => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:30.793563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:30.794111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:30.794721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:30.797686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:30.846113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b003f-870d-45ab-8564-c059cc8f7b4b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:30.847510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:30.849141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.047032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:31.048234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.048671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.049481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] PATH_INFO: `/v3/projects/dcad324a672a462e951dcdce5b62dc5b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.055661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcad324a672a462e951dcdce5b62dc5b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:31.058579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:31.201636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcad324a672a462e951dcdce5b62dc5b', 'request_id': 'req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.229232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcad324a672a462e951dcdce5b62dc5b', 'request_id': 'req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.256571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcad324a672a462e951dcdce5b62dc5b', 'request_id': 'req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.286174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] The token cache is being invalidate because project dcad324a672a462e951dcdce5b62dc5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:31.287525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.290949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ccf8e39a-40a1-4282-9a0d-55af79aa20a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.294129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 907/1803] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:30 2022] DELETE /identity/v3/projects/dcad324a672a462e951dcdce5b62dc5b => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:31.299563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.303132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.306544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.350675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:31.354783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.440702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 897/1804] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 648 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:31.466582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:31.469303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.496931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e55169-91c9-4941-a01f-e15ce67d643a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:31.605552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 908/1805] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:31.606460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:31.608031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.617007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:31.618286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.618953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.619438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] PATH_INFO: `/v3/users/15a60bd3dea34b099e9186b11565cb06` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.621896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a60bd3dea34b099e9186b11565cb06)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:31.623069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:31.625069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:31.708320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a60bd3dea34b099e9186b11565cb06'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.709157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a60bd3dea34b099e9186b11565cb06'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.709885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a60bd3dea34b099e9186b11565cb06'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.734465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a60bd3dea34b099e9186b11565cb06'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.737141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:31.760062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd19d54-b8b8-466e-bf3a-13c60d4bfd05 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:31.776668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2a02a572-8b0f-45a1-925b-ef1e787a61d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a60bd3dea34b099e9186b11565cb06'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:31.785355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:31.790836 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.792048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.793262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.810622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.832624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:31.834646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9d33c-ddd5-4e0e-9fa2-2944eb5b601f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:31.839240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 898/1806] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:31 2022] DELETE /identity/v3/users/15a60bd3dea34b099e9186b11565cb06 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:31.841034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.841333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.841596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.862435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 909/1807] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:31.864750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:31.868209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:31.871483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:31.888372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:31.889855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:31.946170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:31.950688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:32.074514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 899/1808] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:32.079009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.096012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de954b-7d6a-488a-b1e7-5d1ffe9f985f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.111700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.112397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.112681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.112995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.113796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:32.114104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.118057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.172773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 900/1809] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:52:32.175885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.182165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 910/1810] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:32.201776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb258756-8d25-48e7-95fb-3250994cadb2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.208363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.209645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.210082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.210567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.212071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.217434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.261056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.263711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:32.287882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 901/1811] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:32 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:32.293903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.438929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3511b-f191-4e9c-a881-3236105c3621 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.502070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8047e6f-b00c-45d0-9f33-1d764b9c0a26 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.519668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.520415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.520679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.520981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.521686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.525884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.573687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 902/1812] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:32 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:32.576705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.584102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:32.622468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.623144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.623424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.623744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.636922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.637625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9520c-99fb-4850-b94f-d800f96613c8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.638422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.645662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.646780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.646780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.647072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] PATH_INFO: `/v3/users/242e4fc5a9e944b6986fc393952cc3d1` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.649052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] RBAC: Authorizing `identity:delete_user(user_id=242e4fc5a9e944b6986fc393952cc3d1)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.651039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.657623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 911/1813] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:32.658752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.689046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14893ea-2188-4144-8c1d-19a375941bb5 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.698440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.699915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.699915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.700334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.705614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.707608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.720005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:32.756150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 912/1814] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:32.757599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.765123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:32.772197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242e4fc5a9e944b6986fc393952cc3d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:32.775050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242e4fc5a9e944b6986fc393952cc3d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:32.777007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242e4fc5a9e944b6986fc393952cc3d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:32.778079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ab363-7fa1-4bca-a5dd-3553f83d1b45 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.808873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.808873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.808873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.808873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.809544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.809544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.818264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242e4fc5a9e944b6986fc393952cc3d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:32.830433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 913/1815] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:32.835417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:32.837243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:32.857941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1757a8e4-7608-4a70-a65e-b2af27a1635f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242e4fc5a9e944b6986fc393952cc3d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:32.863677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bdd7b7-bf8f-411c-bad5-c5cf2dcf0d05 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:32.874159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 903/1816] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:32 2022] DELETE /identity/v3/users/242e4fc5a9e944b6986fc393952cc3d1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:32.879230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.879706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.880162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.890211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:32.894259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:32.894427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:32.896136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] PATH_INFO: `/v3/projects/79f425e86544495f8638efc153c63ce1/users/b2d3648298fe4175a04e9dda9d7e6310/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:32.905354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:32.907070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:32.952758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f425e86544495f8638efc153c63ce1, user_id=b2d3648298fe4175a04e9dda9d7e6310, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:32.961645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d8131-538d-45a8-87ba-d97cff34d6d7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:32.999436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 914/1817] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:32 2022] PUT /identity/v3/projects/79f425e86544495f8638efc153c63ce1/users/b2d3648298fe4175a04e9dda9d7e6310/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:33.004206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989510-a6d9-4768-a1e2-cf3443da277c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:33.004460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989510-a6d9-4768-a1e2-cf3443da277c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:33.004991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a989510-a6d9-4768-a1e2-cf3443da277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:33.056582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 904/1818] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:33.143867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:33.146563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:33.416852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9f1a0-a5b7-43d9-9c75-e97d08e66a72 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:33.548628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1a989510-a6d9-4768-a1e2-cf3443da277c None None] MFA Rules not processed for user `b2d3648298fe4175a04e9dda9d7e6310`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:33.550327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1a989510-a6d9-4768-a1e2-cf3443da277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:33.632432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:33.633387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:33.633792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:33.634141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:33.661114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:33.831022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 915/1819] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 828 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:33.833559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94591-638f-42a8-9656-ef054baaf049 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:33.835586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94591-638f-42a8-9656-ef054baaf049 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:33.836287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde94591-638f-42a8-9656-ef054baaf049 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:33.842958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 916/1820] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:52:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:52:33.844182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:33.851583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c11c96-839a-43e3-838a-a39d87b9ae58 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:33.857302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94591-638f-42a8-9656-ef054baaf049 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:33.921801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 905/1821] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 779 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:33.932027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde94591-638f-42a8-9656-ef054baaf049 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:33.932177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:33.932422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:33.932699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:33.941462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:33.942940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:33.944274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:33.945125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:33.946036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:33.949658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:33.974125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:34.007696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:34.040870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 917/1822] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:33 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:34.042403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.215576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9439d04-e959-48e4-ab22-ed7d866967c4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:34.220922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 906/1823] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:52:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:34.224067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:34.224771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.225036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.225307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.226134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:34.228640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:34.262522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 918/1824] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:34 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:34.263863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.295866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4227080c-2aa6-42b2-872f-343f999f5b80 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:34.303417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:34.306534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.307547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.308036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.310092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:34.320300 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:34.341980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 907/1825] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:34.342823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.355281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565acd5-4c7b-49ce-8dcf-3d3ba9db7211 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:34.380956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:34.382097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.382573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.382966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] PATH_INFO: `/v3/projects/4a7aba11580f47ffb0150ee76ace1918/users/95db766ba12345429b58e83b9859080b/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.431626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7aba11580f47ffb0150ee76ace1918, user_id=95db766ba12345429b58e83b9859080b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:34.435195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449676a3-78f2-4ac3-86e0-74cfb47af0f1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:34.457980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:34.467425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 919/1826] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:34 2022] PUT /identity/v3/projects/4a7aba11580f47ffb0150ee76ace1918/users/95db766ba12345429b58e83b9859080b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:34.472753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.493824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef355-6e08-4bbf-9aea-291352e6c795 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:34.565232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5b6-9cf5-4da3-a422-d8b94d1c4da5 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.566736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5b6-9cf5-4da3-a422-d8b94d1c4da5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.567186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5d5b6-9cf5-4da3-a422-d8b94d1c4da5 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.570857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 920/1827] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:52:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:52:34.660129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:34.661702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.662446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.663094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.668421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:34.671306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a2c4c-7a2a-45e2-8c24-088683861660 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:34.706036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 908/1828] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:34.712483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5d5b6-9cf5-4da3-a422-d8b94d1c4da5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.731510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5d5b6-9cf5-4da3-a422-d8b94d1c4da5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:34.741383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:34.747373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.747373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.747373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] PATH_INFO: `/v3/projects/4a7aba11580f47ffb0150ee76ace1918/users/95db766ba12345429b58e83b9859080b/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.752663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7aba11580f47ffb0150ee76ace1918, user_id=95db766ba12345429b58e83b9859080b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:34.762126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:34.790335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 921/1829] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:34 2022] PUT /identity/v3/projects/4a7aba11580f47ffb0150ee76ace1918/users/95db766ba12345429b58e83b9859080b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:34.805002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa3a1-9640-4834-844e-b01844309447 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:34.805630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa3a1-9640-4834-844e-b01844309447 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:34.806449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaa3a1-9640-4834-844e-b01844309447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:34.848390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:34.850801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:34.870887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5bdaa3a1-9640-4834-844e-b01844309447 None None] MFA Rules not processed for user `95db766ba12345429b58e83b9859080b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:34.872101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5bdaa3a1-9640-4834-844e-b01844309447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:34.895473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:34.985282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56213bd-a88b-45d9-b4ed-39e7b52e0509 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:35.019002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:35.034216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:35.034497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:35.034781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] PATH_INFO: `/v3/projects/1f16eeababe349c882e43ca1169b072d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:35.040943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f16eeababe349c882e43ca1169b072d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:35.046071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:35.159776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 909/1830] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:35.159776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:35.159776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:35.159776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:35.250237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:35.256187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f16eeababe349c882e43ca1169b072d', 'request_id': 'req-3066c55f-3197-49e4-8e66-2794acff7c48'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:35.258104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.285998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f16eeababe349c882e43ca1169b072d', 'request_id': 'req-3066c55f-3197-49e4-8e66-2794acff7c48'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:35.309320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f16eeababe349c882e43ca1169b072d', 'request_id': 'req-3066c55f-3197-49e4-8e66-2794acff7c48'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:35.368478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] The token cache is being invalidate because project 1f16eeababe349c882e43ca1169b072d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:35.369902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:35.374394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:35.386074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 922/1831] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:34 2022] DELETE /identity/v3/projects/1f16eeababe349c882e43ca1169b072d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:35.390389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:35.397410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.498069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 910/1832] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:35.499349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:35.501249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.616236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29ce51-ae57-456f-bbc2-1e464af311db None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:35.630959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:35.632036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:35.632334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:35.633670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:35.639264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.654396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066c55f-3197-49e4-8e66-2794acff7c48 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:35.677950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:35.678785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:35.679218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:35.679559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:35.681719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.723378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:35.725372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:35.755416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 923/1833] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:35.756366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:35.760939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.773740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:35.785274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:35.806852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:35.809765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45224ed-0cbe-4e8b-a96a-aeedaad183da service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:35.825265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 911/1834] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:35.826693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:35.826986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:35.827270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:35.852541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:35.855667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:35.989662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 912/1835] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:35.992496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:35.997824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.026782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58811a-9b28-4f66-8525-38bac7bad567 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.041890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c3b8-7634-455f-aa20-9f592cc80c9b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.048543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.049583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.049907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.050325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] PATH_INFO: `/v3/projects/7480d0d6ee004f09bf7655ad3631d943` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.051596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7480d0d6ee004f09bf7655ad3631d943)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.053917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.059036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.059972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.060302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.060597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] PATH_INFO: `/v3/projects/7c53448566cc404b82ef1b4b5aa73875` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.068513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c53448566cc404b82ef1b4b5aa73875)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.070761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.127719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7480d0d6ee004f09bf7655ad3631d943', 'request_id': 'req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.137381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7480d0d6ee004f09bf7655ad3631d943', 'request_id': 'req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.150265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7480d0d6ee004f09bf7655ad3631d943', 'request_id': 'req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.182254 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] The token cache is being invalidate because project 7480d0d6ee004f09bf7655ad3631d943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:36.185334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.187338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.190861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 913/1836] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:35 2022] DELETE /identity/v3/projects/7480d0d6ee004f09bf7655ad3631d943 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:36.191831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:36.193480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.194942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c53448566cc404b82ef1b4b5aa73875', 'request_id': 'req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.213838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c53448566cc404b82ef1b4b5aa73875', 'request_id': 'req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.235593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c53448566cc404b82ef1b4b5aa73875', 'request_id': 'req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.265105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] The token cache is being invalidate because project 7c53448566cc404b82ef1b4b5aa73875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:36.265434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.266456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a0cb7b29-8326-449b-8e0c-aaf7eabb9c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.273685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 924/1837] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:35 2022] DELETE /identity/v3/projects/7c53448566cc404b82ef1b4b5aa73875 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:36.281903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693998-325f-4104-b278-d951884df5fc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.282137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693998-325f-4104-b278-d951884df5fc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.282426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693998-325f-4104-b278-d951884df5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.302354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2de1-cd24-4bfd-a1d2-e73f55a8f583 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.346471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-15693998-325f-4104-b278-d951884df5fc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:36.347745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-15693998-325f-4104-b278-d951884df5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.356586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:36.448473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.449301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.449703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.450110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.453194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.492500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 925/1838] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:36.492500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693998-325f-4104-b278-d951884df5fc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:36.492500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-15693998-325f-4104-b278-d951884df5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.565567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:36.608366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.611486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.646415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 914/1839] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:36.649908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:36.654050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.674291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693998-325f-4104-b278-d951884df5fc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.697231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.700174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7485ac-97a4-41df-a147-cc2b92446d9a service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.700802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.701099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.701421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.709451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.719021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.720173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.720466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.720745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] PATH_INFO: `/v3/users/0fadbdd9583242bda583e70dde88c0cc` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.722878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fadbdd9583242bda583e70dde88c0cc)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.725666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.735786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.739000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.783879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 926/1840] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:36.786735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:36.789408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:36.863123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36aa86-fd8b-4963-a9d4-0965f0284632 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:36.890147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:36.899030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:36.899394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:36.899731 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] PATH_INFO: `/v3/users/2d4db1a5c377444f809f0242ba38ac3b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:36.911338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fadbdd9583242bda583e70dde88c0cc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.913781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fadbdd9583242bda583e70dde88c0cc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.913932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4db1a5c377444f809f0242ba38ac3b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:36.914277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fadbdd9583242bda583e70dde88c0cc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:36.921751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:36.958946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fadbdd9583242bda583e70dde88c0cc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.005620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fadbdd9583242bda583e70dde88c0cc'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.055321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 915/1841] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:36 2022] DELETE /identity/v3/users/0fadbdd9583242bda583e70dde88c0cc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:37.063494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.065356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:37.069330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4db1a5c377444f809f0242ba38ac3b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.073327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4db1a5c377444f809f0242ba38ac3b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.095272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4db1a5c377444f809f0242ba38ac3b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.119842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4db1a5c377444f809f0242ba38ac3b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.122600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4db1a5c377444f809f0242ba38ac3b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.155209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:37.161523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 927/1842] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:36 2022] DELETE /identity/v3/users/2d4db1a5c377444f809f0242ba38ac3b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:37.162455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.166991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:37.175623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a0c56-e0c5-4fe5-92aa-76de81a6f500 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.340154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.341864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.342265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.342644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.343575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:37.344008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.344572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a3aaf-1e98-457a-aab1-9b25a24947dc admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.346921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.365460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 916/1843] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:37.370257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.374399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.376189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.376862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.377411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] PATH_INFO: `/v3/projects/19a1d871a5634b828a4dfa753e88fe78` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.379601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:37.392659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a1d871a5634b828a4dfa753e88fe78)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.398039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.421464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610435a0-1663-4e15-bb3a-0d40fe5d76a8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.441984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.442744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.442961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.443233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.444326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.449820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.526395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:37.544736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 917/1844] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:37 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:37.551279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.570243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a1d871a5634b828a4dfa753e88fe78', 'request_id': 'req-a2e72433-8570-4866-bd5a-04e5f3431026'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.595158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a1d871a5634b828a4dfa753e88fe78', 'request_id': 'req-a2e72433-8570-4866-bd5a-04e5f3431026'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.626313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a1d871a5634b828a4dfa753e88fe78', 'request_id': 'req-a2e72433-8570-4866-bd5a-04e5f3431026'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.664450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] The token cache is being invalidate because project 19a1d871a5634b828a4dfa753e88fe78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:37.664763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.666820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:37.672991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 928/1845] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:37 2022] DELETE /identity/v3/projects/19a1d871a5634b828a4dfa753e88fe78 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:37.679406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86358a-bb9e-4f11-9cbe-88a1725f9f6f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.681506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.683973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:37.692901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.693922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.694219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.694660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.695845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.698742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.760269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 918/1846] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:37 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:37.764430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.774289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:37.795647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e7bc2-fed8-4b89-a7c1-ab9344c5182f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.811742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.812476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.812873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.813163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.814267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.816059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.843037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 919/1847] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:37.844097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.866605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847d4bb-9ba1-4ac4-a765-c93d953c3a3c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.871059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e72433-8570-4866-bd5a-04e5f3431026 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.888189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.889476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.889767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.890102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.890475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.890733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] PATH_INFO: `/v3/users/5aacc39c071e466a8d31c2aa9ba1234e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.890834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.891010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:37.891754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.892600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aacc39c071e466a8d31c2aa9ba1234e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:37.895844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.905085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:37.951790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 920/1848] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:37.954160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:37.969230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44428cca-e4cb-4846-8ee2-9457408e8003 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:37.976761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:37.977874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:37.978322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:37.979066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] PATH_INFO: `/v3/projects/18a19ecb02054adebceb9cca2281b889/users/eeb4237178f245dbb293457eaeb251fd/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.020174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a19ecb02054adebceb9cca2281b889, user_id=eeb4237178f245dbb293457eaeb251fd, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:38.030744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aacc39c071e466a8d31c2aa9ba1234e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:38.031903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aacc39c071e466a8d31c2aa9ba1234e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:38.034489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2ce6e-c692-4b61-b5ab-efa452d30796 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:38.079552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 921/1849] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:37 2022] PUT /identity/v3/projects/18a19ecb02054adebceb9cca2281b889/users/eeb4237178f245dbb293457eaeb251fd/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:38.080937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:38.081229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:38.081523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.083628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aacc39c071e466a8d31c2aa9ba1234e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:38.103330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aacc39c071e466a8d31c2aa9ba1234e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:38.103974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aacc39c071e466a8d31c2aa9ba1234e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:38.128766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 929/1850] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:37 2022] DELETE /identity/v3/users/5aacc39c071e466a8d31c2aa9ba1234e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:38.138145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] MFA Rules not processed for user `eeb4237178f245dbb293457eaeb251fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:38.139450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:38.162693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:38.319951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 922/1851] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:38.320865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:38.322748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:38.433779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:38.525875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b305-b3fc-4da1-9fa9-48be8bedf7ab admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:38.547752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:38.548677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:38.548951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:38.549241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.550155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:38.552302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:38.614823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:38.623136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 930/1852] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:38 2022] POST /identity/v3/projects => generated 387 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:38.628760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64d23e-e95a-40b5-b4ff-36fe88f9545b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:38.793192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:38.794177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:38.794592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:38.794878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.795678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:38.800989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:38.845527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:38.853966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 923/1853] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:38 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:38.858686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c54672-e5a8-4b04-b9a3-0285fa4836aa admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:38.863812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:38.864492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:38.864821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:38.865397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.866142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:38.867845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:38.880403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 931/1854] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:38.884638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:38.896534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7f3ee-c41e-4461-bdef-02e73c73dcb5 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:38.902719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:38.904066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:38.904293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:38.904633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] PATH_INFO: `/v3/projects/3420f3e7281549c59f4dd994bd398aac/users/2c079ce96c88436595c29837d04edf67/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:38.922105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3420f3e7281549c59f4dd994bd398aac, user_id=2c079ce96c88436595c29837d04edf67, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:38.925051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:38.952537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 924/1855] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:38 2022] PUT /identity/v3/projects/3420f3e7281549c59f4dd994bd398aac/users/2c079ce96c88436595c29837d04edf67/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:38.953760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:38.966447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37639ff7-811f-4d68-a794-605a5e55e12f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.001965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.005158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.083814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.085142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.085519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.086064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.087035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.088955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.103854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 932/1856] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:39.108283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.108972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf439d-b8e9-442f-bdda-5b65cca85886 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.115052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.116908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.117198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.117476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] PATH_INFO: `/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.119111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e4e7cd3b6047c5b481a3eb1719e74f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.121306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.122358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aeb59-6fc4-4f66-84d3-c72e4ebdaf7a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.127890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.129081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.129436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.129805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] PATH_INFO: `/v3/projects/3420f3e7281549c59f4dd994bd398aac/users/2c079ce96c88436595c29837d04edf67/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.132507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3420f3e7281549c59f4dd994bd398aac, user_id=2c079ce96c88436595c29837d04edf67, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.136130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197ab7d-d81c-46f6-a707-1e0beced7389 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.144684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:39.156743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 933/1857] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:39 2022] PUT /identity/v3/projects/3420f3e7281549c59f4dd994bd398aac/users/2c079ce96c88436595c29837d04edf67/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:39.161132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.161482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.161857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.201155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] MFA Rules not processed for user `2c079ce96c88436595c29837d04edf67`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:39.203445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.215056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e4e7cd3b6047c5b481a3eb1719e74f', 'request_id': 'req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.228878 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e4e7cd3b6047c5b481a3eb1719e74f', 'request_id': 'req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.248397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e4e7cd3b6047c5b481a3eb1719e74f', 'request_id': 'req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.268201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] The token cache is being invalidate because project f0e4e7cd3b6047c5b481a3eb1719e74f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:39.268872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.270609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6cf0a44f-e58e-4733-a6d1-91b24e06e6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.278267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 925/1858] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:39 2022] DELETE /identity/v3/projects/f0e4e7cd3b6047c5b481a3eb1719e74f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:39.279998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72c6c-606a-459f-a529-916b91e952b2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.280229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72c6c-606a-459f-a529-916b91e952b2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.281069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e72c6c-606a-459f-a529-916b91e952b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.302960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e6e72c6c-606a-459f-a529-916b91e952b2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:39.304255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e6e72c6c-606a-459f-a529-916b91e952b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.332073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 934/1859] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:39.345130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.347044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.382108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 926/1860] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:39.389053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:39.391221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.392565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.392565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.427416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:39.429867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.441390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 927/1861] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:39.445020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654eec1-103f-4c04-bd1c-308ab79e8846 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.446546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.449100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.450219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.450496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.450814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.457141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc6bb-285a-46d4-842e-4a6c4d9c8c0a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.463585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.464349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.464629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.464755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.465077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.466333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.468825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:39.469290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.471025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.485929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 928/1862] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:39.507271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.509507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 935/1863] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:39.510493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.510672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.529336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b740e8d-6bf6-4753-8060-4720440611da admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.537139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f8ccb-df34-4d4b-97da-911efc8d5908 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.540043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.540975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.541533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.541533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] PATH_INFO: `/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.544271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d02ca4298ed49bbb9f0831cf71a08f3)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.566679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.572198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.573372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.573866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.574143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.575645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.577863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.635923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 936/1864] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:39.637031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.639770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.682057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d02ca4298ed49bbb9f0831cf71a08f3', 'request_id': 'req-769c3029-f1fa-4bfb-adf0-3344192a1177'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.691199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d02ca4298ed49bbb9f0831cf71a08f3', 'request_id': 'req-769c3029-f1fa-4bfb-adf0-3344192a1177'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.699658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d02ca4298ed49bbb9f0831cf71a08f3', 'request_id': 'req-769c3029-f1fa-4bfb-adf0-3344192a1177'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.719424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] The token cache is being invalidate because project 0d02ca4298ed49bbb9f0831cf71a08f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:39.720118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.721174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.722584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b6ea7-393d-4893-a343-946d03fcd8a4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.726444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 929/1865] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:39 2022] DELETE /identity/v3/projects/0d02ca4298ed49bbb9f0831cf71a08f3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:39.726444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.726444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.738650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:39.797119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.797994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.798273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.798547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] PATH_INFO: `/v3/projects/a5c42300ec7e4250b5d2a08dcbaf2966` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.799773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c42300ec7e4250b5d2a08dcbaf2966)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.801717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.806647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c3029-f1fa-4bfb-adf0-3344192a1177 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.815584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.816271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.816556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.816865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.817563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.819565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6977c82-ab14-4236-beb2-2d3a675010df admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.841620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 930/1866] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:39.842744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.843028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.843298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.859663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c42300ec7e4250b5d2a08dcbaf2966', 'request_id': 'req-6aab8663-fee9-4f05-a433-60bdf0c76db1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.862357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:39.862902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:39.864294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.869946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c42300ec7e4250b5d2a08dcbaf2966', 'request_id': 'req-6aab8663-fee9-4f05-a433-60bdf0c76db1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.876318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c42300ec7e4250b5d2a08dcbaf2966', 'request_id': 'req-6aab8663-fee9-4f05-a433-60bdf0c76db1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.892893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] The token cache is being invalidate because project a5c42300ec7e4250b5d2a08dcbaf2966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:39.893185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.894012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:39.895587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 937/1867] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:39 2022] DELETE /identity/v3/projects/a5c42300ec7e4250b5d2a08dcbaf2966 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:39.896385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.902410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.945553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 931/1868] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:39.945553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:39.945553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:39.955077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356074a-6386-40d1-a407-c2d824ce3c23 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.968530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.969468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.969751 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.970026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] PATH_INFO: `/v3/users/263c0f5571ed42bead4fc5804cb253b0` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.971258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=263c0f5571ed42bead4fc5804cb253b0)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.973374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:39.982982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab8663-fee9-4f05-a433-60bdf0c76db1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:39.992976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:39.993927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:39.994213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:39.994532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:39.995411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:39.997236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b52f67-4016-482f-9398-1c980f727d91 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.010886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 938/1869] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:40.012695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.013232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.013494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.034433 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:40.035555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.035942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '263c0f5571ed42bead4fc5804cb253b0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.036768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '263c0f5571ed42bead4fc5804cb253b0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.037506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '263c0f5571ed42bead4fc5804cb253b0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.044810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 939/1870] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:40.048260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '263c0f5571ed42bead4fc5804cb253b0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.048753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.050316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.070611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d4fd-fab7-45fe-a092-2ddb076f5061 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.071724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '263c0f5571ed42bead4fc5804cb253b0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.076559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.077282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.077565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.077835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.078965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.081793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.094537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 940/1871] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:40.095402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.098457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 932/1872] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:39 2022] DELETE /identity/v3/users/263c0f5571ed42bead4fc5804cb253b0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:40.099304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.107256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223978cd-83cd-4b0a-a30b-48e52da572a1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.116793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.209522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.211103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.211801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.211946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.212965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:40.213785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.216233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.236250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74df05-da18-40cd-83ad-1143e7700080 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.242041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 941/1873] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:40.245877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.248465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.249402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.249839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] PATH_INFO: `/v3/projects/44e3845ebc96482ba318e6acfedacaed/users/bc38b2d751ab4be18d80e87a32752d30/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.253788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.289486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79885f27-472d-4388-9d2c-e38d2fbb53f4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.292773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e3845ebc96482ba318e6acfedacaed, user_id=bc38b2d751ab4be18d80e87a32752d30, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.300666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089b28a-bfb3-492b-a4ca-01e43e61e5d5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.317302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.318110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.318457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.318674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.323545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.323545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.331232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 933/1874] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:40 2022] PUT /identity/v3/projects/44e3845ebc96482ba318e6acfedacaed/users/bc38b2d751ab4be18d80e87a32752d30/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:40.343738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.344121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.344472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.389707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] MFA Rules not processed for user `bc38b2d751ab4be18d80e87a32752d30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:40.391130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.397584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 942/1875] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:40.398577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.438399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.486679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e2760e-1994-41b3-972e-b7915a722304 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.492695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 934/1876] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:40.492918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.493537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.493970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.494386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.494483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.495534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.496279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.498446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.527744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94f0c8-a94a-4ef2-a6da-e79a5c7a4523 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.542473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 943/1877] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/users => generated 281 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:40.543627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.547106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.548043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.548340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.548597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] PATH_INFO: `/v3/users/eeb4237178f245dbb293457eaeb251fd` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.549994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb4237178f245dbb293457eaeb251fd)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.552506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.564146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc9520-0e3d-429c-996b-134b73dd35b5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.573197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.573943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.574388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.574667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.575630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.579189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.616673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 944/1878] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:40.617012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb4237178f245dbb293457eaeb251fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.617604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.618208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb4237178f245dbb293457eaeb251fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.618872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb4237178f245dbb293457eaeb251fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.622047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.627785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb4237178f245dbb293457eaeb251fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.642587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb4237178f245dbb293457eaeb251fd'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.647853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.658433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 935/1879] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:40 2022] DELETE /identity/v3/users/eeb4237178f245dbb293457eaeb251fd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:40.659924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.662081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.696592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025978f-3f04-4210-8391-c8572c797b21 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.744272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7eb39-5be2-4a21-8f5d-32ea29c840f7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.749880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.750761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.751043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.751320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] PATH_INFO: `/v3/projects/46d09f10696b410a8f7581f851837b03` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.752667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d09f10696b410a8f7581f851837b03)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.754676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.755030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.755758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.756051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.756326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.757178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.758795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.773625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 945/1880] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:40.773625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.775233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.796521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb1856-b9cc-4381-8e98-394e0b3d59e0 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.802463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.803296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.803583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.803918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.805680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.807764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94582543-148c-4060-a4df-503e639b1177 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.816189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d09f10696b410a8f7581f851837b03', 'request_id': 'req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.825907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d09f10696b410a8f7581f851837b03', 'request_id': 'req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.833541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d09f10696b410a8f7581f851837b03', 'request_id': 'req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.841383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 946/1881] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/users => generated 291 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:40.843234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.843680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.844122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.851052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] The token cache is being invalidate because project 46d09f10696b410a8f7581f851837b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:40.851689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.852644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:40.854486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 936/1882] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:40 2022] DELETE /identity/v3/projects/46d09f10696b410a8f7581f851837b03 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:40.855476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.857032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.865952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:40.867777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.894286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:40.941439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d31bd-aba4-43ec-9e91-6d67b6aef7d4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.942958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 947/1883] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:40.943520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.944954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.947312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.948161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.948453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.948744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.949523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.951217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767fd3c-78a9-4e4b-8c41-ddef8700f575 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.961273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77343446-9c2e-466d-8bd6-18313c092e4c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:40.965170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 937/1884] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:40.965170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.965170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.965170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.966271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:40.966969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:40.967251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:40.967522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:40.968256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:40.970034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:40.980612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 948/1885] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:40.980612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:40.980612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.984113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:40.984694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:40.999969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 938/1886] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:40.999969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.003701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef963c-446e-40ab-b467-ed9788b55524 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.008748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.009670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.009952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.010226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] PATH_INFO: `/v3/projects/85f62458ef3f4ca181e9883fc7a3f8b0/users/be302a0415d348e0acb0d0d0ef6e9c84/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.021950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.026653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f62458ef3f4ca181e9883fc7a3f8b0, user_id=be302a0415d348e0acb0d0d0ef6e9c84, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.029606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.045035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 939/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:40 2022] PUT /identity/v3/projects/85f62458ef3f4ca181e9883fc7a3f8b0/users/be302a0415d348e0acb0d0d0ef6e9c84/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:41.045828 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.046314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c813781d-9ced-482f-8d4c-f386a0de08d4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.109982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.110742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.111026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.111296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.125986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b353bdc-5cd5-48d2-af64-011399ac7ba2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.130653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.131583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.131906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.132179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] PATH_INFO: `/v3/projects/733638e971314849a6a2fb541d85f99e/users/5b54c2ae33f04fbb812f03b6b9f64505/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.146757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733638e971314849a6a2fb541d85f99e, user_id=5b54c2ae33f04fbb812f03b6b9f64505, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.149690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57763f24-f0ab-46c6-84fb-cb979e86d4e3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.164032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 940/1888] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:41 2022] PUT /identity/v3/projects/733638e971314849a6a2fb541d85f99e/users/5b54c2ae33f04fbb812f03b6b9f64505/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:41.165521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.165851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.166220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.173136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.174585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab40e30-99c5-4c22-96f9-1e015c8255ac service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.185089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 949/1889] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:41.185729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:41.186215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.186503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.186781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.187505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:41.217999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] MFA Rules not processed for user `be302a0415d348e0acb0d0d0ef6e9c84`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:41.219670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:41.228475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.256293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 941/1890] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:41.257644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.268900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a36c32-6bb1-40fb-ab22-ccdf936e7c7b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.273783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.274459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.274740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.275025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.276105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.277419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.288373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 942/1891] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:41.292859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.297664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 950/1892] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:41.298582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.307110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a26fe-33da-43a4-9139-6edf573a3184 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.310448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdee5ec-6b7d-45db-9555-aab2f4fbfe2c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.312551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.313851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.314299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.314722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.315493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:41.315805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.316670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.317665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.318235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.318518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.318842 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] PATH_INFO: `/v3/projects/733638e971314849a6a2fb541d85f99e/users/5b54c2ae33f04fbb812f03b6b9f64505/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.322635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733638e971314849a6a2fb541d85f99e, user_id=5b54c2ae33f04fbb812f03b6b9f64505, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.325414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.335518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 943/1893] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:41.336776 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.358684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 951/1894] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:41 2022] PUT /identity/v3/projects/733638e971314849a6a2fb541d85f99e/users/5b54c2ae33f04fbb812f03b6b9f64505/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:41.359754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.362704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c1aea-0057-42ad-841c-29b6a7cdac4f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.418411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.435114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.435338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190dde1-72b1-405f-921a-f427070e9399 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.436209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.436563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.436932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.437714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.440295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.440479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ba1da-f702-4590-a0df-e9d87e19ef70 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.441118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.441445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.441894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.442656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.444907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.469956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 944/1895] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:41.473324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 952/1896] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:41.474424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.474931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.475218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.475552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.506399 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] MFA Rules not processed for user `5b54c2ae33f04fbb812f03b6b9f64505`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:41.508043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:41.557740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7199a-a5cf-4c3a-a80b-ed1314aba0d9 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.564806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.565904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.566264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.566611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.567576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.571215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.595295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 953/1897] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:41.598958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 945/1898] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:41.600884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.601302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.620088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96c649-181e-4751-9555-280e954fb224 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.621142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c591-8626-4624-925b-25a9b8f942c6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.625087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.626150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.626695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.626817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.627087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.627198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.627366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.628551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.629031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.629822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.630244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.633558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.642203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 946/1899] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:41.643171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.644950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:41.650367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.681707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 954/1900] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:41 2022] POST /identity/v3/users => generated 283 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:41.688980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.707187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63a47e-fcf1-4742-9d4e-78d969299279 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.713129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.714163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.714444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.714714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] PATH_INFO: `/v3/projects/37649bc9c4a7482786c0fce4b590b213/users/ffb4f811c6ee4157ac60ec42062fa272/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.734557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37649bc9c4a7482786c0fce4b590b213, user_id=ffb4f811c6ee4157ac60ec42062fa272, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.738206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.747724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ae6d1-da13-41fb-a659-ff900215d5ce admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.752960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.753862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.754988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.755345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.760331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 955/1901] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:41 2022] PUT /identity/v3/projects/37649bc9c4a7482786c0fce4b590b213/users/ffb4f811c6ee4157ac60ec42062fa272/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:41.760331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.771058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.773492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.801168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 947/1902] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:41.802176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.804488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:41.826687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829401fb-da8d-4cbb-87a4-81e759b7bbb3 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.841600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12423a-8b82-4a62-8615-e56aec4f5aa4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.846315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.847186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.847522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.847908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.848732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.850936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.863397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 956/1903] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:41.864742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.878454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef8825-728f-44f2-89a4-10f03f7e435b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.893011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.893701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.894019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.894306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.895941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.897670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.902669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:41.909568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 957/1904] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:41.910325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.920816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52ab9-3df4-4917-acb3-3f9310e90fbd admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.921490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.922378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.922667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.922946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] PATH_INFO: `/v3/projects/18a19ecb02054adebceb9cca2281b889` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.926799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.927462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.927745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.928018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.928767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a19ecb02054adebceb9cca2281b889)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.928888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.930436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.930857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.941569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 958/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:41.942218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.954165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9fec5-27d0-4b01-b0cb-8428f356fde2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:41.959517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:41.960523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:41.960914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:41.961193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] PATH_INFO: `/v3/projects/37649bc9c4a7482786c0fce4b590b213/users/ffb4f811c6ee4157ac60ec42062fa272/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:41.963289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37649bc9c4a7482786c0fce4b590b213, user_id=ffb4f811c6ee4157ac60ec42062fa272, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:41.966086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:41.984133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a19ecb02054adebceb9cca2281b889', 'request_id': 'req-7b2019ed-b834-49b2-afa0-00643c04eda8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:41.996187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 959/1906] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:41 2022] PUT /identity/v3/projects/37649bc9c4a7482786c0fce4b590b213/users/ffb4f811c6ee4157ac60ec42062fa272/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:41.996187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:41.996768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a19ecb02054adebceb9cca2281b889', 'request_id': 'req-7b2019ed-b834-49b2-afa0-00643c04eda8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.000386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a19ecb02054adebceb9cca2281b889', 'request_id': 'req-7b2019ed-b834-49b2-afa0-00643c04eda8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.023551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] The token cache is being invalidate because project 18a19ecb02054adebceb9cca2281b889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:42.023791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.024498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7b2019ed-b834-49b2-afa0-00643c04eda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.026138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 948/1907] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:41 2022] DELETE /identity/v3/projects/18a19ecb02054adebceb9cca2281b889 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:42.029149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.029149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.029149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.065716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] MFA Rules not processed for user `ffb4f811c6ee4157ac60ec42062fa272`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:42.066989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.141284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fbc21-b9b4-44c1-8d8f-bba455eb80f5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.149218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.149218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.149218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.149218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] PATH_INFO: `/v3/projects/382f7f846a6f4b2ea0d355a962088ad4/users/d1e680ff295649ecb0eab519610dad70/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.155391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 949/1908] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:42.156338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.160189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.177567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382f7f846a6f4b2ea0d355a962088ad4, user_id=d1e680ff295649ecb0eab519610dad70, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.182207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.193206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e93aba2-6f40-407b-ad35-a9a0ed40c5e3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.201788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 960/1909] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:41 2022] PUT /identity/v3/projects/382f7f846a6f4b2ea0d355a962088ad4/users/d1e680ff295649ecb0eab519610dad70/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:42.202679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.204211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.224640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:42.258725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.259615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.259897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.260172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] PATH_INFO: `/v3/users/2c079ce96c88436595c29837d04edf67` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.261436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c079ce96c88436595c29837d04edf67)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.263370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.269463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:42.296651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b3526-5350-46ef-9c7f-2a468a915687 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.302639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.303482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.303785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.304062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.340516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c079ce96c88436595c29837d04edf67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.341268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c079ce96c88436595c29837d04edf67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.342015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c079ce96c88436595c29837d04edf67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.353437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c079ce96c88436595c29837d04edf67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.374879 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eda6ad3b-8579-482c-81a3-e075dbd1ea46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c079ce96c88436595c29837d04edf67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:42.387406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.390504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.399107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 950/1910] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:42 2022] DELETE /identity/v3/users/2c079ce96c88436595c29837d04edf67 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:42.401548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.402048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.402557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.408123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 961/1911] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:42.463486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] MFA Rules not processed for user `d1e680ff295649ecb0eab519610dad70`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:42.466548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.537159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.546367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649bf45-fac0-49b1-8340-fd3787353ad9 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.626328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 951/1912] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:42.632747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.635947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.636665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.636977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.638399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.639480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.645838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.732360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574b0c1-6d65-4bcd-b4fe-06dc28cb0d9d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.736629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.737553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.738460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.738705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.739286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.739676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.740779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.741800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.756520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 962/1913] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:42.771936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:42.785024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.786779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 952/1914] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:42 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:42.806906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235677ff-c0d9-4e4e-a851-e8477c470d73 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.838690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:42.838952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:42.840677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:42.921412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.922041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.922358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.922637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.923995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2fb72-8783-4a0b-a89b-71327e3a60b7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:42.927767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.930846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:42.931969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:42.932171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:42.932265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.932355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] PATH_INFO: `/v3/projects/3420f3e7281549c59f4dd994bd398aac` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:42.939015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3420f3e7281549c59f4dd994bd398aac)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:42.939015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:42.978625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 963/1915] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:42 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:42.982654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.014677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a338caec-5b0f-4b18-b0a1-9a1449f489a7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.036909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3420f3e7281549c59f4dd994bd398aac', 'request_id': 'req-525cebca-0ad8-4171-ab18-7099e406385c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.046804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3420f3e7281549c59f4dd994bd398aac', 'request_id': 'req-525cebca-0ad8-4171-ab18-7099e406385c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.074439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3420f3e7281549c59f4dd994bd398aac', 'request_id': 'req-525cebca-0ad8-4171-ab18-7099e406385c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.102709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] The token cache is being invalidate because project 3420f3e7281549c59f4dd994bd398aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:43.103010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.103687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-525cebca-0ad8-4171-ab18-7099e406385c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.112964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 953/1916] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:42 2022] DELETE /identity/v3/projects/3420f3e7281549c59f4dd994bd398aac => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:43.112964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3844ed-557a-41e0-85f3-d016db10166d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.112964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3844ed-557a-41e0-85f3-d016db10166d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.112964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3844ed-557a-41e0-85f3-d016db10166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.135395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.136090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.138274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.138554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.139303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.140972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.146356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1b3844ed-557a-41e0-85f3-d016db10166d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:43.148422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1b3844ed-557a-41e0-85f3-d016db10166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.155277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 964/1917] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:43.159854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.161741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 954/1918] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:43.162287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.169698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.169992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.170269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.189995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e9f30-709b-41a6-8f30-4d3f6df0b2b5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.197596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.198321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.198633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.198968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] PATH_INFO: `/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639/users/fe283c99c1de492199b4400bfbcb6b67/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.207245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:43.209408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.223757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 955/1919] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:43.224969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.226454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c19bb0fc0f44d7af938c4b22a58639, user_id=fe283c99c1de492199b4400bfbcb6b67, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.235205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.246158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3befc9-cfa4-48f5-ab9b-8389803d9099 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.266796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.267469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.268168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.268535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.269393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:43.269852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.271874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.273051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 965/1920] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:43 2022] PUT /identity/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639/users/fe283c99c1de492199b4400bfbcb6b67/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:43.278665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.300792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 956/1921] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:43.302350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.316204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d01f3d-58d5-4b4b-b7b5-6d6265809ee7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.364271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4efbb-e063-451c-a32d-fbb4c3cda68a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.369859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.370791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.371181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.371516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.372388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.374410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.390386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 966/1922] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:43.392855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.400242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.400971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.401563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.401854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.402823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.404585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1816b568-42af-4936-ae7c-2dffab734220 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.405336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.410128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.411100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.411379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.411653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] PATH_INFO: `/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639/users/fe283c99c1de492199b4400bfbcb6b67/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.413769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c19bb0fc0f44d7af938c4b22a58639, user_id=fe283c99c1de492199b4400bfbcb6b67, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.415713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:43.416537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082927da-d42e-43be-98d8-9f259d2fcf07 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.430932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 967/1923] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:43 2022] PUT /identity/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639/users/fe283c99c1de492199b4400bfbcb6b67/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:43.445078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.445371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.445652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.448770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 957/1924] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:43.451401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.462516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:43.490980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] MFA Rules not processed for user `fe283c99c1de492199b4400bfbcb6b67`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:43.492968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.533255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555f433-2687-4178-b4a4-4a26d2918272 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.545687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.546518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.546810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.547086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.547793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.550041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.578541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 958/1925] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:43.580929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.586086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 968/1926] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:43.594659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2b58b-c507-420b-957b-7ebcaa161944 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.599694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.600364 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.600732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.601015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.601835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.603594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.615293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 959/1927] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:43.619881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.628312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.630921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.633978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc996e-724f-42c5-84e0-d47f71964565 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.638774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.639452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.639838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.640138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.640979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.642697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.655223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 969/1928] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:43.659077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.671323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be75ed0-78db-454f-bc30-9fb826d174bf admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.677997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.678915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.679192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.679604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] PATH_INFO: `/v3/projects/95aaa38e59fd4074a06b6ca7395dae7f/users/823c8f2df77c495fa467a50bfd43aa9d/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.696002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95aaa38e59fd4074a06b6ca7395dae7f, user_id=823c8f2df77c495fa467a50bfd43aa9d, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.699221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4b68-998a-4ad9-8333-4706fff54ccb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.702159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6deee4-36fa-4634-9719-e98c804916de admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.706565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.707289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.707509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.707770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.715131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 970/1929] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:43 2022] PUT /identity/v3/projects/95aaa38e59fd4074a06b6ca7395dae7f/users/823c8f2df77c495fa467a50bfd43aa9d/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:43.719932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.720216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.720493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.721146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.722774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.734216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 960/1930] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:43.738613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:43.740063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.794973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.796530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.811840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e9ac9-2ea0-4d56-9433-e0c62f113dae service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.828710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 971/1931] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:43.838848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.845788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:43.875581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.876651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.876959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.877228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] PATH_INFO: `/v3/users/bc38b2d751ab4be18d80e87a32752d30` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.878731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc38b2d751ab4be18d80e87a32752d30)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.880797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.895040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:43.918064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3de36c-765e-4670-8254-df943d7913cc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:43.922962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:43.922962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.923613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.923613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:43.931108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:43.933670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:43.937422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:43.941925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc38b2d751ab4be18d80e87a32752d30'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.943191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc38b2d751ab4be18d80e87a32752d30'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.944413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc38b2d751ab4be18d80e87a32752d30'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.949626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 972/1932] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:43.951129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:43.958577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc38b2d751ab4be18d80e87a32752d30'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.976019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-092df20e-c3aa-4244-91f7-3b46ac7e2bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc38b2d751ab4be18d80e87a32752d30'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:43.994682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 961/1933] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:43 2022] DELETE /identity/v3/users/bc38b2d751ab4be18d80e87a32752d30 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:43.999209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:43.999556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:43.999840 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:44.026253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:44.027911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:44.047599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35661e9a-c35c-44e6-b2fa-ad2355b69e0c service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:44.116657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 962/1934] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:44.123455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:44.124590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:44.126007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:44.126168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:44.130610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:44.204359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:44.205857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:44.234967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:44.236696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:44.247604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 973/1935] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:44.332525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a58a40-e645-43d9-97b7-f97ad9e94d96 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:44.342250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:44.343030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:44.343411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:44.343881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:44.361282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:44.362989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:44.375644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 963/1936] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:45.356204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:45.358744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:45.374854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def43316-b4e4-45c3-92a7-a0b7537ba544 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:45.380920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:45.381590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:45.381992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:45.382359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] PATH_INFO: `/v3/projects/44e3845ebc96482ba318e6acfedacaed` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:45.383797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e3845ebc96482ba318e6acfedacaed)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:45.386135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:45.444345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e3845ebc96482ba318e6acfedacaed', 'request_id': 'req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.451514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e3845ebc96482ba318e6acfedacaed', 'request_id': 'req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.457252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:45.459317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e3845ebc96482ba318e6acfedacaed', 'request_id': 'req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.483409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] The token cache is being invalidate because project 44e3845ebc96482ba318e6acfedacaed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:45.483699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.484563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-32a1b664-49b3-45ad-b4ca-a5e0c8ce3bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.486342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 974/1937] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:45 2022] DELETE /identity/v3/projects/44e3845ebc96482ba318e6acfedacaed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:45.491847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:45.506901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000c59-6f0e-4b6b-9bf1-e2f7a8dc574d service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:45.550859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:45.557007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:45.557465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:45.557741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:45.594077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:45.596251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:45.596922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:45.597398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] PATH_INFO: `/v3/users/5b54c2ae33f04fbb812f03b6b9f64505` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:45.599293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b54c2ae33f04fbb812f03b6b9f64505)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:45.600578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] MFA Rules not processed for user `823c8f2df77c495fa467a50bfd43aa9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:45.602026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:45.602164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:45.704595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b54c2ae33f04fbb812f03b6b9f64505'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.705466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b54c2ae33f04fbb812f03b6b9f64505'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.706119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b54c2ae33f04fbb812f03b6b9f64505'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.708267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 975/1938] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:45.715032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:45.719920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b54c2ae33f04fbb812f03b6b9f64505'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.721310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:45.741544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ae3bf-7821-472c-9594-ea9a413d36ea None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:45.746696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:45.747437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:45.747725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:45.748003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:45.748797 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:45.752891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:45.760949 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b54c2ae33f04fbb812f03b6b9f64505'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:45.776031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 964/1939] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:45 2022] DELETE /identity/v3/users/5b54c2ae33f04fbb812f03b6b9f64505 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:45.787862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 976/1940] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:45 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:45.792169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:45.794699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:45.867938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60b84f-a1ab-4ce5-bc21-ab12ba85699e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:45.952190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:45.952889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:45.953176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:45.953449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:45.954156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:45.956120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:45.964627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:45.987661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 965/1941] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:45 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:45.991591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:46.002537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ad014-98f5-4877-b633-e3dfe3913046 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:46.016229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:46.016957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.017241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.018952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.019800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:46.028364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:46.044164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 977/1942] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:46.045538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:46.061010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac0177-c222-4a5e-b0e6-1bb42a2d3ecd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:46.076792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:46.078135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.078419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.078696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] PATH_INFO: `/v3/projects/91430ebeeec848c482a921855fd4d68d/users/babf70e0f6534588be4389a12b88833e/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.102429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91430ebeeec848c482a921855fd4d68d, user_id=babf70e0f6534588be4389a12b88833e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:46.106294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:46.126148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:46.127209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 966/1943] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:46 2022] PUT /identity/v3/projects/91430ebeeec848c482a921855fd4d68d/users/babf70e0f6534588be4389a12b88833e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:46.139212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70986497-a4ea-43e0-928d-e9ae7620fc29 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:46.238386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:46.239477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.239795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.239973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.244107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:46.244107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:46.281843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 978/1944] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:46.286039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:46.305769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c581e-2a60-4812-8a6e-70ee5338af73 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:46.324324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:46.327336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.328455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.329311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] PATH_INFO: `/v3/projects/91430ebeeec848c482a921855fd4d68d/users/babf70e0f6534588be4389a12b88833e/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.339259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91430ebeeec848c482a921855fd4d68d, user_id=babf70e0f6534588be4389a12b88833e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:46.351034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852cac3-b52d-40a6-a46e-935038f33f62 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:46.384804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 967/1945] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:46 2022] PUT /identity/v3/projects/91430ebeeec848c482a921855fd4d68d/users/babf70e0f6534588be4389a12b88833e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:46.465499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:46.467997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:46.491840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8336c-b82a-4f44-9a84-88770729d482 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:46.582864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:46.626946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:46.627933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.628300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.628818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] PATH_INFO: `/v3/projects/733638e971314849a6a2fb541d85f99e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.631267 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733638e971314849a6a2fb541d85f99e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:46.634389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:46.736565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733638e971314849a6a2fb541d85f99e', 'request_id': 'req-c5da038b-70e5-42de-846a-029d49b724c4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:46.748307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42994-225b-469e-8a6d-6275cc332d8c None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.748927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42994-225b-469e-8a6d-6275cc332d8c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.749098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce42994-225b-469e-8a6d-6275cc332d8c None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.751673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 968/1946] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 20 14:52:46.753164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733638e971314849a6a2fb541d85f99e', 'request_id': 'req-c5da038b-70e5-42de-846a-029d49b724c4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:46.769436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733638e971314849a6a2fb541d85f99e', 'request_id': 'req-c5da038b-70e5-42de-846a-029d49b724c4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:46.772999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e79a-35f3-4637-93e8-f336ece255ed None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.773507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e79a-35f3-4637-93e8-f336ece255ed None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.773829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518e79a-35f3-4637-93e8-f336ece255ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.803954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] The token cache is being invalidate because project 733638e971314849a6a2fb541d85f99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:46.804243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:46.806287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c5da038b-70e5-42de-846a-029d49b724c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:46.810284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 979/1947] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:46 2022] DELETE /identity/v3/projects/733638e971314849a6a2fb541d85f99e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:46.816176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:46.816455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:46.816747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:46.818531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d518e79a-35f3-4637-93e8-f336ece255ed None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:46.825551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d518e79a-35f3-4637-93e8-f336ece255ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:46.896688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:46.902084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:46.967062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 969/1948] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:47.084528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 980/1949] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:47.092929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.093402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.093887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.130700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:47.134013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:47.162358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 970/1950] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:47.169143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.189200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c7438-bb83-4583-8da1-0def23630792 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.202173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.204983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.205371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.208078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.220558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:47.220910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.222582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.251050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.252917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:47.271987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219882d-70eb-4477-bde9-402d5bf40b65 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.280629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.281703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.282203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.283834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 981/1951] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:47.284452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.287703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.295869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.298719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.312918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce93268-d185-490a-b40c-5d44affd0ccb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.330422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 971/1952] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:47.339306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.340604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.340934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.341226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.341934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.346956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c247e-2fb7-453c-9686-ffb8162c4295 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.434476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 982/1953] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:47.439148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.454093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cdbc-b95d-4ae0-bd4b-b1b2cd2832f1 service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.595205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.595900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.596189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.596466 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.597335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.599872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.639974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47174da-dabe-4358-811e-53bc7497942b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.640487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47174da-dabe-4358-811e-53bc7497942b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.640487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47174da-dabe-4358-811e-53bc7497942b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.667842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 972/1954] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:47 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:47.669115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.673032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f47174da-dabe-4358-811e-53bc7497942b None None] MFA Rules not processed for user `babf70e0f6534588be4389a12b88833e`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:47.674287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f47174da-dabe-4358-811e-53bc7497942b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:47.691285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fadda-7f1a-48f8-ba5a-4887b07e6965 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.697143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.697956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.698241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.698533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.699237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.701387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.703352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:47.719580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 973/1955] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:47.720970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.728681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:47.738919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903a4f2-0554-4604-a2f9-99447b2e8415 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.751068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.751899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.752604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.752604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.753573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.756421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.764944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 983/1956] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:47.770820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 974/1957] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:52:47.777609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47174da-dabe-4358-811e-53bc7497942b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.779559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:47.782151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:47.793912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47174da-dabe-4358-811e-53bc7497942b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.799947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.802196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.802196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.802196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] PATH_INFO: `/v3/projects/345427db11e74473914c2b202bcc07df/users/7038010996fc4e0783be8e89116f89d9/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.834422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=345427db11e74473914c2b202bcc07df, user_id=7038010996fc4e0783be8e89116f89d9, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:47.837879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c38f8-42d6-4149-8b5e-4fc221a6c871 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:47.877839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 984/1958] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:47 2022] PUT /identity/v3/projects/345427db11e74473914c2b202bcc07df/users/7038010996fc4e0783be8e89116f89d9/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:47.882889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.884701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.885065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.901929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab342ab6-0d1e-46dd-aed2-714eba7ec6d2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:47.965619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] MFA Rules not processed for user `7038010996fc4e0783be8e89116f89d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:47.967568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:47.981208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:47.981966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:47.982207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:47.982520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:47.985124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:48.060491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.062572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.074626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 975/1959] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:47 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:48.178846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 985/1960] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:48.184914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:48.436175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354be8e-8fa5-4208-9d85-f1a41990e0ab service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:48.446281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:48.447437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:48.448006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:48.448538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:48.449908 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.466537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.489323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:48.564444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 976/1961] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:48 2022] POST /identity/v3/projects => generated 387 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:48.565106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:48.589096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1bd02-147a-4cba-88a2-4c4f4cd2e936 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:48.735032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:48.738592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:48.738958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:48.739306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:48.741248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.745913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.779028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:48.785949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 986/1962] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:48 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:48.793869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca8e49-4963-456f-872b-830895259d14 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:48.801159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:48.801939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:48.802460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:48.803341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:48.804375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.806320 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.832999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 977/1963] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:48.833975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:48.845667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a3078-56a9-4965-b500-70273fb9ec4e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:48.849935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:48.850958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:48.851164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:48.851435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] PATH_INFO: `/v3/projects/52ec179b85a44a1e938d6996c6442038/users/5c68870867a24feebf93e49b12de8eff/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:48.871180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ec179b85a44a1e938d6996c6442038, user_id=5c68870867a24feebf93e49b12de8eff, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.874176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.877278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:48.892771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 987/1964] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:48 2022] PUT /identity/v3/projects/52ec179b85a44a1e938d6996c6442038/users/5c68870867a24feebf93e49b12de8eff/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:48.897002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:48.911057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76299a4a-5d6f-42d6-8ac5-2648121e8e79 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:48.971717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:48.972376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:48.972657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:48.972970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:48.973738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:48.975528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec6312-fc82-42c8-9cf2-71558bfc52d2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:48.987461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 978/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:48.991895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:49.002372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7ea65-5d40-440b-bdbf-9b92acd75b22 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:49.009584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:49.010579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.010863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.011333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] PATH_INFO: `/v3/projects/52ec179b85a44a1e938d6996c6442038/users/5c68870867a24feebf93e49b12de8eff/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.013596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ec179b85a44a1e938d6996c6442038, user_id=5c68870867a24feebf93e49b12de8eff, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:49.016710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:49.029449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 988/1966] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:48 2022] PUT /identity/v3/projects/52ec179b85a44a1e938d6996c6442038/users/5c68870867a24feebf93e49b12de8eff/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:49.040404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.040677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.040985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.068693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] MFA Rules not processed for user `5c68870867a24feebf93e49b12de8eff`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:49.070065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:49.139185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 979/1967] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:49.150802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:49.152834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:49.213417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b54266-fc1f-4966-89f5-74baaa11aeb2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:49.217869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:49.218526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.218831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.219102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.229053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:49.230507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0afb5a-290f-4ddb-ac78-4dff26d3ecb6 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:49.240035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 989/1968] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:49.311228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:49.375360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:49.382517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6a45-123e-426a-9b5c-d07a518c2719 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:49.392038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:49.393546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.394013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.394376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] PATH_INFO: `/v3/users/7038010996fc4e0783be8e89116f89d9` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.396341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7038010996fc4e0783be8e89116f89d9)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:49.398648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:49.453341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7038010996fc4e0783be8e89116f89d9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:49.454363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7038010996fc4e0783be8e89116f89d9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:49.455230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7038010996fc4e0783be8e89116f89d9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:49.466236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7038010996fc4e0783be8e89116f89d9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:49.478832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7038010996fc4e0783be8e89116f89d9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:49.491715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 980/1969] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:49 2022] DELETE /identity/v3/users/7038010996fc4e0783be8e89116f89d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:49.496409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.496697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.497012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.515479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:49.516750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:49.577743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 990/1970] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:49.587576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:49.589233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:49.649453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33afccc-6acf-4235-8ff9-39aa59197479 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:49.653883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:49.654652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:49.654934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:49.655204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:49.666060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:49.667528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:49.677943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 981/1971] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:50.163208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:50.165425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:50.180307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e742c57-8112-4def-9429-59c6ac16e856 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:50.190691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:50.194177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:50.195177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:50.195310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] PATH_INFO: `/v3/projects/345427db11e74473914c2b202bcc07df` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:50.196647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=345427db11e74473914c2b202bcc07df)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:50.198680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:50.258659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '345427db11e74473914c2b202bcc07df', 'request_id': 'req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.269180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '345427db11e74473914c2b202bcc07df', 'request_id': 'req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.277694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '345427db11e74473914c2b202bcc07df', 'request_id': 'req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.293202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] The token cache is being invalidate because project 345427db11e74473914c2b202bcc07df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:50.293499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.294130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.296149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 991/1972] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:50 2022] DELETE /identity/v3/projects/345427db11e74473914c2b202bcc07df => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:50.300392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:50.311506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fdfb-e4af-4b17-b769-8d2862336eb9 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:50.379757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:50.380656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:50.380968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:50.381238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] PATH_INFO: `/v3/users/5c68870867a24feebf93e49b12de8eff` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:50.382578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c68870867a24feebf93e49b12de8eff)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:50.384534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:50.409761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:50.436634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c68870867a24feebf93e49b12de8eff'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.437293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c68870867a24feebf93e49b12de8eff'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.437888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c68870867a24feebf93e49b12de8eff'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.448024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c68870867a24feebf93e49b12de8eff'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.461264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f315ec82-9675-4aa4-a7ed-9af96fffbd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c68870867a24feebf93e49b12de8eff'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.474414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 982/1973] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:50 2022] DELETE /identity/v3/users/5c68870867a24feebf93e49b12de8eff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:50.753446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:50.755001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:50.770961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3e0a6-3bc9-4527-8fa5-f3426b916444 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:50.775363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:50.839007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:50.839784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:50.840042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:50.840344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] PATH_INFO: `/v3/projects/52ec179b85a44a1e938d6996c6442038` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:50.841608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ec179b85a44a1e938d6996c6442038)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:50.843514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:50.897261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ec179b85a44a1e938d6996c6442038', 'request_id': 'req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.907521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ec179b85a44a1e938d6996c6442038', 'request_id': 'req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.914110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ec179b85a44a1e938d6996c6442038', 'request_id': 'req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.945754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] The token cache is being invalidate because project 52ec179b85a44a1e938d6996c6442038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:50.946217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.947684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:50.950231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 992/1974] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:50 2022] DELETE /identity/v3/projects/52ec179b85a44a1e938d6996c6442038 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:50.956463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315ddb-5965-46a2-a3f7-c31edcec3610 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:50.956830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315ddb-5965-46a2-a3f7-c31edcec3610 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:50.957163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c315ddb-5965-46a2-a3f7-c31edcec3610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:50.957940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:50.959066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:50.982076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1c315ddb-5965-46a2-a3f7-c31edcec3610 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:50.983368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1c315ddb-5965-46a2-a3f7-c31edcec3610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.066505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c266c-08d4-4c1f-bcfa-871eac4769e3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.070601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.071467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.071819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.072162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.074416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.077178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 983/1975] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:51.078780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.079074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.079351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.102003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:51.104369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.118758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 984/1976] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:51.124238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.135861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2dd98-d1cc-492c-a9b7-def98569cc38 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.144308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.145019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.145430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.145830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.146291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:51.146569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:51.147447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.150964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.170308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 985/1977] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:51.175006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.176896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.180271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.196911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 993/1978] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:51.201464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6ca98-f00e-4246-be8b-57721dfb7224 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.208171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.208983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.209454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.212851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.212851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.213026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.260843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 986/1979] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:51.261557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.273928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21f8bb-fb2c-4cda-bee2-9c988d705fd6 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.390952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.391664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.391939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.392243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.393298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.395273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.421103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 994/1980] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:51 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:51.422578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.435653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9b466-aca0-462a-97f8-2187266a6557 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.451522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.452234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.452496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.452811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.454940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.455723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.466930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 987/1981] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:51.470998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.481856 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07354fd-bc40-45bf-b778-fd545c108abd admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.491317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.492054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.492355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.492602 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.493457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.495138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff429a-4556-4b32-9392-2e88f7eb4afd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.507257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 995/1982] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:51.512274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.528235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5c418-2362-4c7b-9309-ba2a01de1b7a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.533631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.534528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.534805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.535123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] PATH_INFO: `/v3/projects/cb98b9b8c95547c18a46e5d39eb8e456/users/d9486fac8b124abf8fecbc3ad37e6212/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.551472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb98b9b8c95547c18a46e5d39eb8e456, user_id=d9486fac8b124abf8fecbc3ad37e6212, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.554607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.573291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 988/1983] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:51 2022] PUT /identity/v3/projects/cb98b9b8c95547c18a46e5d39eb8e456/users/d9486fac8b124abf8fecbc3ad37e6212/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:51.584348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.584702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.585143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.622667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] MFA Rules not processed for user `d9486fac8b124abf8fecbc3ad37e6212`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:51.624096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.651343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.653379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.686440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:51.715713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 996/1984] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:51.728191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.729609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.730323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7d3c7-a0d3-40d4-a423-2c6e6a023c12 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.734985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.735866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.736153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.736425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] PATH_INFO: `/v3/users/d1e680ff295649ecb0eab519610dad70` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.737669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e680ff295649ecb0eab519610dad70)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.739800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.796804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e680ff295649ecb0eab519610dad70'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:51.797809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e680ff295649ecb0eab519610dad70'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:51.799506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e680ff295649ecb0eab519610dad70'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:51.801667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67115ff9-f735-48f1-8691-ee33bdb0c266 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.809955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.810960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.811344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e680ff295649ecb0eab519610dad70'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:51.811465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.811678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.813957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.834193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.836614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.842620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-93d1c85f-612d-4c9f-a9f8-b5761a6e5327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e680ff295649ecb0eab519610dad70'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:51.843129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:51.854379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 997/1985] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:51.877902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:51.879713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.887149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 989/1986] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:51 2022] DELETE /identity/v3/users/d1e680ff295649ecb0eab519610dad70 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:51.892981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.893305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.893756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.905328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07017f23-123f-4c4b-bf9e-c94292b7effa service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:51.915834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:51.917083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:51.975977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:51.978990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:51.979563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:51.979814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] PATH_INFO: `/v3/users/d9486fac8b124abf8fecbc3ad37e6212` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:51.982170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9486fac8b124abf8fecbc3ad37e6212)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:51.984381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:51.994446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 990/1987] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:52.004571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:52.005996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:52.066538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9486fac8b124abf8fecbc3ad37e6212'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:52.067516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9486fac8b124abf8fecbc3ad37e6212'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:52.082307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9486fac8b124abf8fecbc3ad37e6212'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:52.085833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:52.095613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9486fac8b124abf8fecbc3ad37e6212'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:52.096958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a283550d-c7be-4569-9ad0-14be52662004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9486fac8b124abf8fecbc3ad37e6212'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:52.106731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f76e-e1a9-42b1-a375-0c8bde252906 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:52.111679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:52.112944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:52.113357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:52.113619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:52.116268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:52.119331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 998/1988] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:51 2022] DELETE /identity/v3/users/d9486fac8b124abf8fecbc3ad37e6212 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:52.123813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:52.124202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:52.124479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:52.139057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:52.140965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:52.143683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:52.145034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:52.154985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 991/1989] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:52.222260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 999/1990] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:52.253116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:52.255241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:52.276050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dd6f1-86fc-4829-9f65-06dbf11a3587 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:52.337717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:52.338392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:52.338677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:52.339004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:52.351654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:52.354368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:52.369744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 992/1991] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:52.954506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:52.955960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:52.967163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:52.969128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.003675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72cb4c-cf9c-4db0-a96e-f2555ea0c2ca None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.014084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3f9fe-ec01-47ac-8572-fe21ad7d0411 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.017026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.018112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.018406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.018909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] PATH_INFO: `/v3/projects/cb98b9b8c95547c18a46e5d39eb8e456` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.020916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb98b9b8c95547c18a46e5d39eb8e456)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.023966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.025024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.027736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.028249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.029695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] PATH_INFO: `/v3/projects/382f7f846a6f4b2ea0d355a962088ad4` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.032438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382f7f846a6f4b2ea0d355a962088ad4)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.037348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.043214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:53.114315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb98b9b8c95547c18a46e5d39eb8e456', 'request_id': 'req-a521c698-d1e5-4160-ade3-225b88283a24'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.132970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb98b9b8c95547c18a46e5d39eb8e456', 'request_id': 'req-a521c698-d1e5-4160-ade3-225b88283a24'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.141499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb98b9b8c95547c18a46e5d39eb8e456', 'request_id': 'req-a521c698-d1e5-4160-ade3-225b88283a24'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.154809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382f7f846a6f4b2ea0d355a962088ad4', 'request_id': 'req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.166901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382f7f846a6f4b2ea0d355a962088ad4', 'request_id': 'req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.169225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] The token cache is being invalidate because project cb98b9b8c95547c18a46e5d39eb8e456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:53.169827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.172532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a521c698-d1e5-4160-ade3-225b88283a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.176330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1000/1992] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:52 2022] DELETE /identity/v3/projects/cb98b9b8c95547c18a46e5d39eb8e456 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:53.178211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382f7f846a6f4b2ea0d355a962088ad4', 'request_id': 'req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.191379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b74b-90cd-47bf-8dcd-3acc7925343c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.191379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b74b-90cd-47bf-8dcd-3acc7925343c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.191379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b74b-90cd-47bf-8dcd-3acc7925343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.200338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] The token cache is being invalidate because project 382f7f846a6f4b2ea0d355a962088ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:53.200631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.201306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.203451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 993/1993] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:52 2022] DELETE /identity/v3/projects/382f7f846a6f4b2ea0d355a962088ad4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:53.208154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c198b74b-90cd-47bf-8dcd-3acc7925343c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:53.208858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.209515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c198b74b-90cd-47bf-8dcd-3acc7925343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.210506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.277542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1001/1994] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:53.285623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.285953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.286991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.309359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd889d-093c-4f9b-a9a9-f7764d6616d3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.318015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.319491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.319958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.320648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] PATH_INFO: `/v3/users/fe283c99c1de492199b4400bfbcb6b67` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.322622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe283c99c1de492199b4400bfbcb6b67)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.325653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.342805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:53.344057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.348985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:53.368556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1002/1995] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:53.370420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.384129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e6097-c3c3-4c96-8743-847b7b7a4d30 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.390655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.391534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.391919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.392537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.393741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:53.394243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.397358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.424009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe283c99c1de492199b4400bfbcb6b67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.424944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe283c99c1de492199b4400bfbcb6b67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.425702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe283c99c1de492199b4400bfbcb6b67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.435298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1003/1996] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:53.436557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.436674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe283c99c1de492199b4400bfbcb6b67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.441844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.458262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe283c99c1de492199b4400bfbcb6b67'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.459440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55419968-0c92-45f4-ae04-08c373fd965f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.464871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.465720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.466099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.466564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.467546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.469604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.479779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 994/1997] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:53 2022] DELETE /identity/v3/users/fe283c99c1de492199b4400bfbcb6b67 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:53.503646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1004/1998] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:53.508591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.576255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130ad1b-e651-43cb-97da-8952d5d5973c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.635638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.636302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.636649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.636994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.637682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.639512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.661699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 995/1999] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/users => generated 281 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:53.665877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.678926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41997f-0bd9-49ce-b0c1-f7e7bd9e9536 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.685616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.686559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.686826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.687049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.687887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.690528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.702380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1005/2000] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:52:53.706868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.718564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b0eb8-8f02-4b63-95e2-a98d61e1495f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.723379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.724054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.724340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.724635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.725936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.727573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.742239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 996/2001] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:53.746577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.758895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1478e6-f447-4424-812f-962ee457a228 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.770037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.771293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.772190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.772442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] PATH_INFO: `/v3/projects/6e9da3f5472544f999057207bc34e58e/users/284e69566fb24954b46073f665a073c5/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.782188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:53.785817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.812574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9da3f5472544f999057207bc34e58e, user_id=284e69566fb24954b46073f665a073c5, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.814179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a580fde-fc29-4050-8391-0c126b9fcc13 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:53.821215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:53.822506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.822901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.823283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] PATH_INFO: `/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.823545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d8955-e1fc-43ef-a136-56cc93e48b6d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.825015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c19bb0fc0f44d7af938c4b22a58639)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:53.835604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:53.854876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:53.871826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1006/2002] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:53 2022] PUT /identity/v3/projects/6e9da3f5472544f999057207bc34e58e/users/284e69566fb24954b46073f665a073c5/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:53.873947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.874258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.874537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.917013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] MFA Rules not processed for user `284e69566fb24954b46073f665a073c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:53.918343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:53.928657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c19bb0fc0f44d7af938c4b22a58639', 'request_id': 'req-f570e9a6-43e3-45de-b16e-33bc13213f7a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.932060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:53.937638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c19bb0fc0f44d7af938c4b22a58639', 'request_id': 'req-f570e9a6-43e3-45de-b16e-33bc13213f7a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.945728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c19bb0fc0f44d7af938c4b22a58639', 'request_id': 'req-f570e9a6-43e3-45de-b16e-33bc13213f7a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.963502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] The token cache is being invalidate because project c1c19bb0fc0f44d7af938c4b22a58639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:53.964020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.964965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f570e9a6-43e3-45de-b16e-33bc13213f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:53.967142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 997/2003] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:53 2022] DELETE /identity/v3/projects/c1c19bb0fc0f44d7af938c4b22a58639 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:53.971983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616e24-5491-4d83-b78c-7696dccd7a84 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:53.973226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616e24-5491-4d83-b78c-7696dccd7a84 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:53.973864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c616e24-5491-4d83-b78c-7696dccd7a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:53.994109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0c616e24-5491-4d83-b78c-7696dccd7a84 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:53.995419 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0c616e24-5491-4d83-b78c-7696dccd7a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.012893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1007/2004] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:54.040314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.041760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.076873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 998/2005] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:54.080962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.081264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.081548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.101013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:54.102343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.108928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e4be9-5afe-482c-ba71-1074260ee55b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.110440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 999/2006] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:54.112665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.113366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.113720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.114032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.114717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.123867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.124852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd08938-d7e7-4a18-9b25-47c7ecf69b29 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.129601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.130259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.130537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.130808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.131212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.131753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:54.133681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.134224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.142584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1008/2007] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:54.148487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1000/2008] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:52:54.152796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.158965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.161186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.166188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fee4b-7e18-4b1f-8fac-f9d94f1e9d00 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.172158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.173192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.173651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.174077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.175049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.176837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9152f32-0e67-44b4-8169-2a61d3bf9b64 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.177486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.182313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.183296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.184390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.184775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] PATH_INFO: `/v3/users/284e69566fb24954b46073f665a073c5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.186153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284e69566fb24954b46073f665a073c5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.189178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.238214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1009/2009] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:54 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:54.242824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.302375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284e69566fb24954b46073f665a073c5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.303346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284e69566fb24954b46073f665a073c5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.304351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284e69566fb24954b46073f665a073c5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.316529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284e69566fb24954b46073f665a073c5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.342899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ae6e0b31-1362-4e24-9449-31571e2f3bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284e69566fb24954b46073f665a073c5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.345110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:54.369450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1001/2010] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:54 2022] DELETE /identity/v3/users/284e69566fb24954b46073f665a073c5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:54.374495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.375009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.376008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.400194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:54.401083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedddfa4-c681-47d2-8b65-c6a9ab7e4903 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.401768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.477986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:54.483123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1002/2011] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:54.484453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.486108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.501054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe0aa9-b8f7-467c-b5c5-9525e967a6c3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.508665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.509795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.510476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.510476 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] PATH_INFO: `/v3/users/be302a0415d348e0acb0d0d0ef6e9c84` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.512096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be302a0415d348e0acb0d0d0ef6e9c84)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.514383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.530290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.531960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.532571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.532700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.533746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.540709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.577421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1010/2012] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:54 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:54.578937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.580645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.630197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be302a0415d348e0acb0d0d0ef6e9c84'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.631003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be302a0415d348e0acb0d0d0ef6e9c84'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.631824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be302a0415d348e0acb0d0d0ef6e9c84'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.654135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be302a0415d348e0acb0d0d0ef6e9c84'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.675336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be302a0415d348e0acb0d0d0ef6e9c84'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:54.676985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b3b39-e266-445b-8e08-5cf83b6258f3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.693101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1003/2013] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:54 2022] DELETE /identity/v3/users/be302a0415d348e0acb0d0d0ef6e9c84 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:54.694095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.695695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.697560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.699981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.700287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.700650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.704101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.735086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.737464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e98644-e55a-43ee-90a9-33c5a10c23f8 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.749317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1011/2014] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:54.751089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.751528 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.752100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.779011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:54.780538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.811077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcd93d-77ef-4790-84c0-3ed03c2276e7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.826701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.827684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.828206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.828750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.829972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.832286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.840902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:54.850482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1004/2015] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:54.855360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.880235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227e087-3712-4be3-942e-4d32ad3d01d7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.887426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.888171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.888553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.888984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.889777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1012/2016] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:54.893219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.894966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:54.903973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.905883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:54.923279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1005/2017] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:52:54.926028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:54.951236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3480c8b-c2aa-4a8c-b449-2998af310536 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:54.957784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:54.959106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:54.959566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:54.960064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] PATH_INFO: `/v3/projects/515cbcfb6d57478aa1425c8c603cd49f/users/a48da25bbb464c0e9373abf03ab64012/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:54.995442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=515cbcfb6d57478aa1425c8c603cd49f, user_id=a48da25bbb464c0e9373abf03ab64012, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:54.999131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4cd33-5e28-443a-a13b-fa54e358ea1c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.034604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6486cfc-e566-4691-823b-4fcbf8872379 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:55.041223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1006/2018] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:54 2022] PUT /identity/v3/projects/515cbcfb6d57478aa1425c8c603cd49f/users/a48da25bbb464c0e9373abf03ab64012/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:55.051820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.052403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.052520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.110029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] MFA Rules not processed for user `a48da25bbb464c0e9373abf03ab64012`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:55.111106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:55.111799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.162331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:55.163460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.163579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.163917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.258281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1007/2019] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:55.267024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.268545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.303901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:55.309968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.326512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1013/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:55.327516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.328841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.345919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b530b3-cf12-4ca7-8b6d-b0c62a9afa15 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:55.352645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:55.354018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.354563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.354868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] PATH_INFO: `/v3/projects/6e9da3f5472544f999057207bc34e58e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.356297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9da3f5472544f999057207bc34e58e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:55.358533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.372472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38274407-10e4-449e-b4e9-a823819fcb80 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:55.377620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:55.378710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.379089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.379459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.390855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:55.392475 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c591-e7e5-4963-b0bd-80d4c8a34b4b service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.407181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1008/2021] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:55.435691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9da3f5472544f999057207bc34e58e', 'request_id': 'req-3e993d6a-cd92-406f-b59d-b5857bf0e035'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.444613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9da3f5472544f999057207bc34e58e', 'request_id': 'req-3e993d6a-cd92-406f-b59d-b5857bf0e035'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.451636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9da3f5472544f999057207bc34e58e', 'request_id': 'req-3e993d6a-cd92-406f-b59d-b5857bf0e035'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.478314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] The token cache is being invalidate because project 6e9da3f5472544f999057207bc34e58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:55.478654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.480570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3e993d6a-cd92-406f-b59d-b5857bf0e035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.483004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1014/2022] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:55 2022] DELETE /identity/v3/projects/6e9da3f5472544f999057207bc34e58e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:55.487794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.488277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.488707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.519937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:55.521330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.622744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:55.636896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1009/2023] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:55.646800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.647146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.647504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.658406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.659845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.672542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b559b-3c0f-4ef6-8be8-600e70a18d97 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:55.677498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:55.678579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.678935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.679276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] PATH_INFO: `/v3/projects/85f62458ef3f4ca181e9883fc7a3f8b0` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.680647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f62458ef3f4ca181e9883fc7a3f8b0)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:55.682872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.690430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:55.693212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.704749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1015/2024] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:55.709755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.727866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2491f-d735-4e56-9f5c-d4c02dcf3c14 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:55.751406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f62458ef3f4ca181e9883fc7a3f8b0', 'request_id': 'req-c138487e-05bf-43f4-86bd-1a65609e9a86'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.766875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f62458ef3f4ca181e9883fc7a3f8b0', 'request_id': 'req-c138487e-05bf-43f4-86bd-1a65609e9a86'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.785313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f62458ef3f4ca181e9883fc7a3f8b0', 'request_id': 'req-c138487e-05bf-43f4-86bd-1a65609e9a86'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.815302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] The token cache is being invalidate because project 85f62458ef3f4ca181e9883fc7a3f8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:55.815616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.818561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:55.823459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1010/2025] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:55 2022] DELETE /identity/v3/projects/85f62458ef3f4ca181e9883fc7a3f8b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:55.827545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.829508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.879636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:55.891873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:55.891981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:55.892310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:55.892500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:55.894773 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:55.895095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:55.897631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:55.929714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1016/2026] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:55.940228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:55.943377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:55.986834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4da5be-7a35-4f8e-b92d-ced1e93f8476 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.000628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.002716 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.003729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.004020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.009118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.019657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.031805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138487e-05bf-43f4-86bd-1a65609e9a86 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.041820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.042726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.043287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.043287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] PATH_INFO: `/v3/users/ffb4f811c6ee4157ac60ec42062fa272` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.048178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb4f811c6ee4157ac60ec42062fa272)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.050856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.069066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1017/2027] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:55 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:52:56.072272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.113537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb4f811c6ee4157ac60ec42062fa272'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.114472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb4f811c6ee4157ac60ec42062fa272'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.115384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb4f811c6ee4157ac60ec42062fa272'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.126307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb4f811c6ee4157ac60ec42062fa272'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.155365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb4f811c6ee4157ac60ec42062fa272'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.156973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302757a3-0e99-4c68-90f6-b17c9942b8c8 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.164881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.165639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.165927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.166304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.167054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.169284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.172504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:56.184642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1011/2028] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:55 2022] DELETE /identity/v3/users/ffb4f811c6ee4157ac60ec42062fa272 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:56.197905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1018/2029] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:56 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:56.201859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.204865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:56.352614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e60b4e-6175-4afe-a4aa-27c69ea168da admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.370786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.372639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.372968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.374293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.377334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.379071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.406221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1012/2030] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:52:56.411628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.459699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f8ba0-7585-4dad-9eea-0c95f1d160d8 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.481945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.482675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.483095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.483363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.484104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.485759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87544c-6a71-4c4a-b157-789b304fd3da admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.517974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1019/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:56.519530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.533164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a177eb-2058-4d53-961c-9c88a1bd8d3c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.538959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.540509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.540916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.541396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] PATH_INFO: `/v3/projects/c461f88b7a00462c99532ec1262cb23c/users/a4a159cc0128485482851c885de78e5d/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.559261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c461f88b7a00462c99532ec1262cb23c, user_id=a4a159cc0128485482851c885de78e5d, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.563215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.588700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1013/2032] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:56 2022] PUT /identity/v3/projects/c461f88b7a00462c99532ec1262cb23c/users/a4a159cc0128485482851c885de78e5d/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:56.591080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.591368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.591644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.610821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:56.612045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:56.653306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.656295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:56.709231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1020/2033] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:56.726594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:56.728361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:56.755408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf19e-efd1-444f-bb98-28d4f3f49416 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.762590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.763605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.763895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.764310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] PATH_INFO: `/v3/projects/37649bc9c4a7482786c0fce4b590b213` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.765577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37649bc9c4a7482786c0fce4b590b213)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.767663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.793443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:56.799537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a54c1-500e-4fcf-9044-fea77591c3e6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:56.806639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:56.807565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.807951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.808325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.822364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:56.832869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecb7f4-fc7c-49bd-a883-6930fc13d9ab service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:56.842356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37649bc9c4a7482786c0fce4b590b213', 'request_id': 'req-6d724c8e-9de7-437b-89f1-bbdf8837b51e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.842356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37649bc9c4a7482786c0fce4b590b213', 'request_id': 'req-6d724c8e-9de7-437b-89f1-bbdf8837b51e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.846548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1021/2034] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:56.851504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37649bc9c4a7482786c0fce4b590b213', 'request_id': 'req-6d724c8e-9de7-437b-89f1-bbdf8837b51e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.867312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] The token cache is being invalidate because project 37649bc9c4a7482786c0fce4b590b213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:52:56.867653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.868402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6d724c8e-9de7-437b-89f1-bbdf8837b51e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:56.872807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1014/2035] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:52:56 2022] DELETE /identity/v3/projects/37649bc9c4a7482786c0fce4b590b213 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:56.876590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:56.877159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:56.877263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:56.905187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:56.906727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:57.007411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1022/2036] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:57.015602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.015888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.016177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.023295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:57.039277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:57.041524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:57.056889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1015/2037] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:57.057849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.072960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43e51-6132-47a7-8747-67eab90af5fd None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.079990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.080672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.081007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.081280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.082145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:52:57.082638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.084288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.105678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1023/2038] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:52:57.111831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.127076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa476844-6065-425f-b5e5-9f704c8ccdab None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.141596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.142631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.143049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.143386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.144499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.146441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.185069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1016/2039] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:57 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:57.189887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.205177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf8bc4-54f0-44dd-89f9-39a360d2520c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.308614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.311056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.311691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.312575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.346619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.350088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.417513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1024/2040] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:57 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:57.418816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.437807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf1a0d-c143-4ff7-b31b-569b5fb2ef0e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.445062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.446830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.447423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.448080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.449090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.451037 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.465075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1017/2041] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:52:57.469556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.491341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56879c57-21d6-493a-aada-19d95a821e51 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.496537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.497371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.497662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.497940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.498699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.500343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27752579-2ce9-457e-898e-52d723018fcd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.529135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1025/2042] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:57.532649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:57.544677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b50c0-ccfe-44db-8e71-1940beed3f02 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:57.558568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:57.560677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.562201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.562583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] PATH_INFO: `/v3/projects/e5084d5297e448f7a5dba05ab9bd3cce/users/dcc180e3f351405d9927806a9c98749d/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.610327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5084d5297e448f7a5dba05ab9bd3cce, user_id=dcc180e3f351405d9927806a9c98749d, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:57.618106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:57.649009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1018/2043] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:57 2022] PUT /identity/v3/projects/e5084d5297e448f7a5dba05ab9bd3cce/users/dcc180e3f351405d9927806a9c98749d/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:57.660284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:57.660573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:57.660877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:57.725268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] MFA Rules not processed for user `dcc180e3f351405d9927806a9c98749d`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:57.727125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:57.817048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:57.877280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1026/2044] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:57.882345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.024152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21444862-396a-4243-9150-3db5350434e6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.034961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.036256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.041495 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.042326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.043089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.046322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.106158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1019/2045] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:52:57 2022] POST /identity/v3/projects => generated 389 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:58.109819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.125257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c0c5b-8c52-47b3-ab13-0db71fe8bf1e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.206275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.207138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.208676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.208676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.208676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.211928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.238642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1027/2046] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:52:58 2022] POST /identity/v3/users => generated 301 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:52:58.242779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.256987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3be26-ced9-464c-8597-f241cd1979a9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.263127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.263976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.264264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.264541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.265312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.267341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.281918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1020/2047] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:58.286720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.298323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1733422-2ba5-48bb-a7f0-bc821d001b62 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.304199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.305445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.305576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.305816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] PATH_INFO: `/v3/projects/c7b38ac353c746e183d748817aa5f1e0/users/26ecf0cc82dc44209882ee744854c0bb/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.347724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b38ac353c746e183d748817aa5f1e0, user_id=26ecf0cc82dc44209882ee744854c0bb, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.351506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.370271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1028/2048] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:58 2022] PUT /identity/v3/projects/c7b38ac353c746e183d748817aa5f1e0/users/26ecf0cc82dc44209882ee744854c0bb/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:58.374548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.388898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8646d9-bd63-4728-9539-8ea58507bc9c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.525226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.525915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.526198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.526617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.527620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.529798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b46dca-0bd5-4dc8-95f3-587341365c91 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.546595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1021/2049] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:52:58.548157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.561213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2e060-7b4f-4a3f-ac60-73c64868429c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:58.566877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:58.568011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.568506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.569053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] PATH_INFO: `/v3/projects/c7b38ac353c746e183d748817aa5f1e0/users/26ecf0cc82dc44209882ee744854c0bb/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.575908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b38ac353c746e183d748817aa5f1e0, user_id=26ecf0cc82dc44209882ee744854c0bb, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:58.578889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc0ab2-f421-4057-b9f2-a120b693f565 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:58.602831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1029/2050] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:52:58 2022] PUT /identity/v3/projects/c7b38ac353c746e183d748817aa5f1e0/users/26ecf0cc82dc44209882ee744854c0bb/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:58.613820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.614117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.614403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.649957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:58.671812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] MFA Rules not processed for user `26ecf0cc82dc44209882ee744854c0bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:58.673115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:58.845651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:58.846182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:58.846742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:58.876507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1022/2051] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:58.888641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:58.890426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:58.943472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] MFA Rules not processed for user `a4a159cc0128485482851c885de78e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:58.945005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:59.036975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f661e2e-08fb-4415-b63e-a6d994f268ed None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.041183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.041858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.042434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.042434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.052691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.054852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.066365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1023/2052] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:52:59.087269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1030/2053] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:59.120034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:59.131582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8b824-8dc8-4366-b94f-e9afde129d0c service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.135889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.136556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.136888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.137167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.152043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.154425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.169461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1024/2054] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:59.374859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:59.376298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:59.456539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:59.515219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e6c4a-f1ff-4b40-95ac-89d88032c6b5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.522171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.523463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.523607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.523869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] PATH_INFO: `/v3/users/a48da25bbb464c0e9373abf03ab64012` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.525357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48da25bbb464c0e9373abf03ab64012)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.527351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.625592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48da25bbb464c0e9373abf03ab64012'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.627348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48da25bbb464c0e9373abf03ab64012'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.646231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:59.654400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48da25bbb464c0e9373abf03ab64012'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.661258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dc33d-6593-4914-9b69-06d4df33a696 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.664262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48da25bbb464c0e9373abf03ab64012'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.665432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1d625e30-a6ba-4dfd-a173-2151c5da109f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48da25bbb464c0e9373abf03ab64012'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.682003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.682821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.684294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1031/2055] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:59 2022] DELETE /identity/v3/users/a48da25bbb464c0e9373abf03ab64012 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:52:59.684501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.684811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] PATH_INFO: `/v3/users/dcc180e3f351405d9927806a9c98749d` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.686107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc180e3f351405d9927806a9c98749d)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.689058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.690073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb69e-b92a-4a28-8884-4423a8e61e3b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.690371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb69e-b92a-4a28-8884-4423a8e61e3b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.690644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48fb69e-b92a-4a28-8884-4423a8e61e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.711162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f48fb69e-b92a-4a28-8884-4423a8e61e3b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:59.715093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f48fb69e-b92a-4a28-8884-4423a8e61e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:59.749754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc180e3f351405d9927806a9c98749d'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.750590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc180e3f351405d9927806a9c98749d'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.751267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc180e3f351405d9927806a9c98749d'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.761224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc180e3f351405d9927806a9c98749d'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.777019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc180e3f351405d9927806a9c98749d'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:52:59.784332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:59.792336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1032/2056] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:52:59.795060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1025/2057] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:52:59 2022] DELETE /identity/v3/users/dcc180e3f351405d9927806a9c98749d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:52:59.799686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.799978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.800253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.804670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:59.806347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:59.819725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:52:59.821614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:52:59.879407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:52:59.891504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c1cdc-5e93-4e65-88e1-2b95e1253fe1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.895418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.896102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.896381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.896651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.904581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1033/2058] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:52:59.909020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.910882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.915283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:52:59.922767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1026/2059] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:52:59.926561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc52c48-427f-4674-b53f-371da99430b3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:52:59.931495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:52:59.932750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:52:59.933281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:52:59.933562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:52:59.944322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:52:59.946065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:52:59.956753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1034/2060] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:00.369823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.371664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.386329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c31ed-c213-49cf-99cd-99bbd4d2d768 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.392011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.395044 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.395329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.395698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] PATH_INFO: `/v3/projects/515cbcfb6d57478aa1425c8c603cd49f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.397641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515cbcfb6d57478aa1425c8c603cd49f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.405072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.413152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.414974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.432780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a5c6-105f-4c2f-b720-3f3a03db57a5 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.440075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.441469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.441929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.442357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] PATH_INFO: `/v3/projects/e5084d5297e448f7a5dba05ab9bd3cce` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.443692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5084d5297e448f7a5dba05ab9bd3cce)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.445737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.459528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515cbcfb6d57478aa1425c8c603cd49f', 'request_id': 'req-4636d276-5aa6-47de-91cb-7b7820638690'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.466251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515cbcfb6d57478aa1425c8c603cd49f', 'request_id': 'req-4636d276-5aa6-47de-91cb-7b7820638690'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.478848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515cbcfb6d57478aa1425c8c603cd49f', 'request_id': 'req-4636d276-5aa6-47de-91cb-7b7820638690'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.503432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] The token cache is being invalidate because project 515cbcfb6d57478aa1425c8c603cd49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:00.503842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.504965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4636d276-5aa6-47de-91cb-7b7820638690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.506583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1027/2061] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:00 2022] DELETE /identity/v3/projects/515cbcfb6d57478aa1425c8c603cd49f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:00.517813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0cb6-e9d5-4813-932c-8c7de5fd372e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.518220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0cb6-e9d5-4813-932c-8c7de5fd372e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.518683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0cb6-e9d5-4813-932c-8c7de5fd372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.528890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5084d5297e448f7a5dba05ab9bd3cce', 'request_id': 'req-4725731b-0a55-4924-825d-eb96ba39089e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.537536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5084d5297e448f7a5dba05ab9bd3cce', 'request_id': 'req-4725731b-0a55-4924-825d-eb96ba39089e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.544946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5084d5297e448f7a5dba05ab9bd3cce', 'request_id': 'req-4725731b-0a55-4924-825d-eb96ba39089e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.545140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-17ae0cb6-e9d5-4813-932c-8c7de5fd372e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:00.546590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-17ae0cb6-e9d5-4813-932c-8c7de5fd372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.561040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] The token cache is being invalidate because project e5084d5297e448f7a5dba05ab9bd3cce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:00.561569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.562503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.564956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1035/2062] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:00 2022] DELETE /identity/v3/projects/e5084d5297e448f7a5dba05ab9bd3cce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:00.568959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.570659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.618938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1028/2063] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:00.627208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.627506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.627783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.647121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:00.647970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725731b-0a55-4924-825d-eb96ba39089e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.648519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.652888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.663805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.663805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.663805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] PATH_INFO: `/v3/users/26ecf0cc82dc44209882ee744854c0bb` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.663805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ecf0cc82dc44209882ee744854c0bb)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.664115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1029/2064] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:00.664286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.668814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.679241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b0550-3956-4e59-8d4f-53092a50633a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.685953 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.686619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.687322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.687322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.687920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:00.688227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.690477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.703986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1030/2065] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:00.708416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.714365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:00.718777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ecf0cc82dc44209882ee744854c0bb'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.719812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ecf0cc82dc44209882ee744854c0bb'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.723336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c2b13-543d-4e52-9ede-5426544cf5ec admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.731898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:00.732428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.734112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.734581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.735256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.735560 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ecf0cc82dc44209882ee744854c0bb'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.736149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.738179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ba5eb-e003-47d1-985a-eeb57a9ed1ca admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.762179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ecf0cc82dc44209882ee744854c0bb'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.763083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ecf0cc82dc44209882ee744854c0bb'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:00.771888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1031/2066] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:00 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:00.773599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.773880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.774264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.782587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1036/2067] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:00 2022] DELETE /identity/v3/users/26ecf0cc82dc44209882ee744854c0bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:00.787539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:00.789960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.801611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] MFA Rules not processed for user `a4a159cc0128485482851c885de78e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:00.803524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:00.911906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65c-c64f-4980-a972-d82fe8550016 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:00.923290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:00.924016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:00.924306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:00.924586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:00.927320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:00.930434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:00.962771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1032/2068] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:01.000785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1037/2069] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:00 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:01.003196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.017765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4466-4dfb-4604-bb78-142001ab1238 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.042199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.043483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.043912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.044332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.058923 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.060599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.112416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1033/2070] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:01.117621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.128599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b1b30-3719-47df-9d3f-8526d55b1143 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.135675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.136594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.136990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.137400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.138499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.140485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bf2d8-b35f-469d-96cc-c9829de9976f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.155809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1038/2071] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:01.161032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.180267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf7f2f-866e-405d-88ae-577981797bc3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.186537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.187477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.187767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.188041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] PATH_INFO: `/v3/projects/11cc20b2e85d4c5b81f48078cad62188/users/28b4a840250e4973916a45761e9b6874/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.206808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11cc20b2e85d4c5b81f48078cad62188, user_id=28b4a840250e4973916a45761e9b6874, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.209460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.226513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1034/2072] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:01 2022] PUT /identity/v3/projects/11cc20b2e85d4c5b81f48078cad62188/users/28b4a840250e4973916a45761e9b6874/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:01.237839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.238180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.238461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.268506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] MFA Rules not processed for user `28b4a840250e4973916a45761e9b6874`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:01.269849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:01.380553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1039/2073] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:01.381152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.383812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:01.389268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.391089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:01.452872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e8c1-d8fb-43bd-bbdd-68182c94bc9a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.457681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.458522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:01.458635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.458824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.459388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] PATH_INFO: `/v3/projects/c7b38ac353c746e183d748817aa5f1e0` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.461885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b38ac353c746e183d748817aa5f1e0)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.464088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.480065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6d8ca-4f2f-4701-8859-5dd3c662625a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.484513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.485234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.485523 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.485924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.497119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.498600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f7f09-2240-42c3-8177-3669cb893968 service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.509457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1040/2074] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:01.521611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b38ac353c746e183d748817aa5f1e0', 'request_id': 'req-99c55945-f104-4178-ab41-8e11e11f434a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:01.525857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:01.536211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b38ac353c746e183d748817aa5f1e0', 'request_id': 'req-99c55945-f104-4178-ab41-8e11e11f434a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:01.544687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b38ac353c746e183d748817aa5f1e0', 'request_id': 'req-99c55945-f104-4178-ab41-8e11e11f434a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:01.560980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] The token cache is being invalidate because project c7b38ac353c746e183d748817aa5f1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:01.561899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:01.562685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-99c55945-f104-4178-ab41-8e11e11f434a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:01.566115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1035/2075] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:01 2022] DELETE /identity/v3/projects/c7b38ac353c746e183d748817aa5f1e0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:01.571828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.572162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.572553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.592432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:01.593695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:01.690281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1041/2076] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:01.700026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.700119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.700494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.723067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:01.724544 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:01.735851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1036/2077] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:01.739880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.757323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02addced-5e13-4ed1-ae14-2df4ce80babc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.762439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.764756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.764756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.764756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.765115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:01.765398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.767087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.785646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1042/2078] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:01.790080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.809074 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3903f0-63b3-4827-a9d4-45f78c14edc7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.809941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.810841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.811125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.811449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.812163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.816103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.849602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1037/2079] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:01 2022] POST /identity/v3/projects => generated 407 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:01.854129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:01.865831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b296-054e-413a-bc09-dde6fcdb6a31 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:01.945960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:01.946861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:01.947176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:01.948014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:01.948845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:01.951197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:01.976310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1043/2080] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:01 2022] POST /identity/v3/users => generated 304 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:01.981339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.000634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefd1d4-296e-4c38-84bc-29fbd43f121b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.014517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.015312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.015652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.015974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.016811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.018676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.039767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1038/2081] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:02.043872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.056741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1258-b7d2-4623-a47c-3cc1776265a7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.070875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.071584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.071972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.072198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.072995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.074618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678c070-4580-4417-8e2d-e0b4ba021565 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.089666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1044/2082] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:02.093740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.129184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc849b0-dd86-48b4-b5fd-e9c842111853 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.136918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.138493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.138972 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.139578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] PATH_INFO: `/v3/projects/cdc28e48e2054b758f8f78c1db78f89c/users/4b0f0be821434e91ac329cb52e3d01e0/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.175341 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc28e48e2054b758f8f78c1db78f89c, user_id=4b0f0be821434e91ac329cb52e3d01e0, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.199013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.223995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1039/2083] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:02 2022] PUT /identity/v3/projects/cdc28e48e2054b758f8f78c1db78f89c/users/4b0f0be821434e91ac329cb52e3d01e0/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:02.237068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.237498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.237911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.273405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] MFA Rules not processed for user `4b0f0be821434e91ac329cb52e3d01e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:02.274660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:02.341814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:02.376213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1045/2084] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:02.380847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.481545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01033-b15c-430f-a588-e0ace3dc9081 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.486756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.487421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.487714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.488249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.488816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.491186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.522503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1040/2085] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:02 2022] POST /identity/v3/projects => generated 407 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:02.523692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.534621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c631b-3bbe-433c-ab73-4a3e1f7a2d9c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.611144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.611726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.612013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.612292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.613026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.614976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.638388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1046/2086] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:02 2022] POST /identity/v3/users => generated 310 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:02.643659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.654741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbec281-e739-4c79-b5f8-224860c6f953 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.659724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.660380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.660664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.660930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.661698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.663422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.674787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1041/2087] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:02.681364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.697207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b7312-cb96-43f4-8295-2d748c9bbc49 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.704356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.705727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.706013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.706285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] PATH_INFO: `/v3/projects/17f60d49361a4fa89f97e551d93cb36f/users/1e4bd9eb9b1f44ba8b044b4fa181abad/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.722954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f60d49361a4fa89f97e551d93cb36f, user_id=1e4bd9eb9b1f44ba8b044b4fa181abad, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.725940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.741422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1047/2088] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:02 2022] PUT /identity/v3/projects/17f60d49361a4fa89f97e551d93cb36f/users/1e4bd9eb9b1f44ba8b044b4fa181abad/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:02.745821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.756947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a343-7230-4960-bacc-2dcfa456629d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.812660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:02.826082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.827056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.827515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.827799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.828579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.830605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254f228-8379-4fa1-b353-746b4316118f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.841344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1042/2089] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:02.845843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:02.856945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a00e4-8c41-41ea-893c-28d3b741b216 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:02.861868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:02.862717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.863028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.863304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] PATH_INFO: `/v3/projects/17f60d49361a4fa89f97e551d93cb36f/users/1e4bd9eb9b1f44ba8b044b4fa181abad/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.865333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f60d49361a4fa89f97e551d93cb36f, user_id=1e4bd9eb9b1f44ba8b044b4fa181abad, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:02.868317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:02.880074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1048/2090] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:02 2022] PUT /identity/v3/projects/17f60d49361a4fa89f97e551d93cb36f/users/1e4bd9eb9b1f44ba8b044b4fa181abad/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:02.890677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:02.890973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:02.891252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:02.919215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] MFA Rules not processed for user `1e4bd9eb9b1f44ba8b044b4fa181abad`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:02.920414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:02.993897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1043/2091] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:03.004890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:03.006905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:03.065390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125619-5043-491a-b4ea-cf83cf798cfa admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:03.069417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:03.070053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:03.070332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:03.070595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:03.080963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:03.082425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:03.092056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1049/2092] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:03 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:03.250912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:03.252408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:03.264528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce43052-1dc3-489f-a5ab-c8a61b8a9f7a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:03.269063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:03.269813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:03.270478 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:03.270757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:03.331528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:03.333026 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:03.342230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1044/2093] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:03 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:13.087831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=77,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:13.338016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=68 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:15.049873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.052411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:15.124799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f565f-5b6c-483a-971a-96cd94ce88eb service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.129467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.130389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.130672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.131003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] PATH_INFO: `/v3/users/823c8f2df77c495fa467a50bfd43aa9d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.132302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=823c8f2df77c495fa467a50bfd43aa9d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.134470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:15.139695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.150664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac3c24-ab53-42e2-82a5-d037ff283179 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.155936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.156944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.157227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.157502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] PATH_INFO: `/v3/users/4b0f0be821434e91ac329cb52e3d01e0` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.158767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0f0be821434e91ac329cb52e3d01e0)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.160778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:15.202253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '823c8f2df77c495fa467a50bfd43aa9d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.203463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '823c8f2df77c495fa467a50bfd43aa9d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.227582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '823c8f2df77c495fa467a50bfd43aa9d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.241224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '823c8f2df77c495fa467a50bfd43aa9d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.241984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-390565f5-95d6-414d-8509-9a407fbb5b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '823c8f2df77c495fa467a50bfd43aa9d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.258539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0f0be821434e91ac329cb52e3d01e0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.259632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0f0be821434e91ac329cb52e3d01e0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.259849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0f0be821434e91ac329cb52e3d01e0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.268900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0f0be821434e91ac329cb52e3d01e0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.272073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1050/2094] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:15 2022] DELETE /identity/v3/users/823c8f2df77c495fa467a50bfd43aa9d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:15.285952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0f0be821434e91ac329cb52e3d01e0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.299499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1045/2095] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:15 2022] DELETE /identity/v3/users/4b0f0be821434e91ac329cb52e3d01e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:15.304220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.304601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.304919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.329775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:15.331084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:15.396659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1051/2096] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:15.407557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.409275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:15.470119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724565d-d589-4e46-9a0d-8dfe77a23e41 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.473743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.474390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.474721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.474996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.484384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.485871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:15.495820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1046/2097] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:15.506471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.508171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:15.522459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c659d9-38da-427f-a6d9-82f74c857a4f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.530024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.530977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.531217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.547861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] PATH_INFO: `/v3/projects/95aaa38e59fd4074a06b6ca7395dae7f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.567833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95aaa38e59fd4074a06b6ca7395dae7f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.570160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:15.590893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:15.657115 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95aaa38e59fd4074a06b6ca7395dae7f', 'request_id': 'req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.671897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95aaa38e59fd4074a06b6ca7395dae7f', 'request_id': 'req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.707246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95aaa38e59fd4074a06b6ca7395dae7f', 'request_id': 'req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.728989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] The token cache is being invalidate because project 95aaa38e59fd4074a06b6ca7395dae7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:15.729388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.730092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.732355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1052/2098] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:15 2022] DELETE /identity/v3/projects/95aaa38e59fd4074a06b6ca7395dae7f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:15.736172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.748006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c935b7-d1a6-4c08-bed4-61f1cdc34e28 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.823377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.825997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.826363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.826710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] PATH_INFO: `/v3/users/babf70e0f6534588be4389a12b88833e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.828444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babf70e0f6534588be4389a12b88833e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.830502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:15.851270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:15.915179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babf70e0f6534588be4389a12b88833e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.915986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babf70e0f6534588be4389a12b88833e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.916735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babf70e0f6534588be4389a12b88833e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.925992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:15.926815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babf70e0f6534588be4389a12b88833e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.927404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:15.943906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babf70e0f6534588be4389a12b88833e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:15.948313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b857fd8-e07a-4c2a-a96f-0aa3594d3084 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:15.962340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:15.963396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:15.964287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:15.964583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] PATH_INFO: `/v3/projects/cdc28e48e2054b758f8f78c1db78f89c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:15.968408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc28e48e2054b758f8f78c1db78f89c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:15.968807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1047/2099] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:15 2022] DELETE /identity/v3/users/babf70e0f6534588be4389a12b88833e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:15.970634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.048305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc28e48e2054b758f8f78c1db78f89c', 'request_id': 'req-21ee402c-29b0-4fde-a712-b1d97ab88dd4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.056599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc28e48e2054b758f8f78c1db78f89c', 'request_id': 'req-21ee402c-29b0-4fde-a712-b1d97ab88dd4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.070231 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc28e48e2054b758f8f78c1db78f89c', 'request_id': 'req-21ee402c-29b0-4fde-a712-b1d97ab88dd4'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.103680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] The token cache is being invalidate because project cdc28e48e2054b758f8f78c1db78f89c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:16.103979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.105919 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.108347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1053/2100] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:15 2022] DELETE /identity/v3/projects/cdc28e48e2054b758f8f78c1db78f89c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:16.112831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.115245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:16.194342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5366c6-7079-4734-8e81-af813cc48179 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.274385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.275359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.275692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.275979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] PATH_INFO: `/v3/users/1e4bd9eb9b1f44ba8b044b4fa181abad` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.277226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4bd9eb9b1f44ba8b044b4fa181abad)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.279386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.300403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.302032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:16.323529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee402c-29b0-4fde-a712-b1d97ab88dd4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.328426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.329406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.329754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.330026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] PATH_INFO: `/v3/projects/91430ebeeec848c482a921855fd4d68d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.331290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91430ebeeec848c482a921855fd4d68d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.333351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.383309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:16.392227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4bd9eb9b1f44ba8b044b4fa181abad'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.394072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4bd9eb9b1f44ba8b044b4fa181abad'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.394906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4bd9eb9b1f44ba8b044b4fa181abad'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.402983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91430ebeeec848c482a921855fd4d68d', 'request_id': 'req-92856730-36f4-4e22-845c-f3fafc7fc236'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.408999 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4bd9eb9b1f44ba8b044b4fa181abad'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.415090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91430ebeeec848c482a921855fd4d68d', 'request_id': 'req-92856730-36f4-4e22-845c-f3fafc7fc236'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.422715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91430ebeeec848c482a921855fd4d68d', 'request_id': 'req-92856730-36f4-4e22-845c-f3fafc7fc236'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.425514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1c9d8ddf-aef3-45d2-8df0-cbe43e5bf024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4bd9eb9b1f44ba8b044b4fa181abad'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.443897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] The token cache is being invalidate because project 91430ebeeec848c482a921855fd4d68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:16.444501 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.445396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-92856730-36f4-4e22-845c-f3fafc7fc236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:16.447191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1048/2101] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:16 2022] DELETE /identity/v3/users/1e4bd9eb9b1f44ba8b044b4fa181abad => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:16.449233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1054/2102] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:16 2022] DELETE /identity/v3/projects/91430ebeeec848c482a921855fd4d68d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:16.459676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.465442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.465932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.487001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:16.488242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:16.582952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1049/2103] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:16.591409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.591690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.591961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.611460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:16.612685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:16.621959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1055/2104] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:16.625897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.635991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca38588-9efa-4608-b1b1-62e6048dec3d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.641111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.641777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.642041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.642312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.643063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:16.643358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.644993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.657600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1050/2105] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:16.662923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.667841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:16.674485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728f69b-9407-4c66-89b1-c96b70007e30 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.683511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.684198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.684480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.684926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.685648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.687595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.719761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1056/2106] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:16 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:16.721461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.732267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3921d-e4c7-4dbe-a871-78de44bde0c0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.798754 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.799432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.799716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.799985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.800748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.802798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.827948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1051/2107] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:16 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:16.834287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.849309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c4c9c-bd1d-40ce-a011-53b66a8b7f84 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.855464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.856330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.856704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.857118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.858618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.860499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.878425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1057/2108] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:16.881956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.892761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced4d39-2c0a-4e79-90be-c99e838e6a3a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.898114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.898782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.899062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.900029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.900029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.902021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9fa8d6-1a48-454e-b1e9-7d1bbbe4c793 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.924079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1052/2109] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:16.925391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:16.939674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd1056-0261-4e75-8152-81458e39e5e2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:16.947640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:16.948889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:16.949232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:16.949573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] PATH_INFO: `/v3/projects/5262807271604083b54f93d8cddce7a8/users/e0fa6969178242cd955ea25f6fd76be7/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:16.967217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5262807271604083b54f93d8cddce7a8, user_id=e0fa6969178242cd955ea25f6fd76be7, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:16.970103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:16.995714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1058/2110] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:16 2022] PUT /identity/v3/projects/5262807271604083b54f93d8cddce7a8/users/e0fa6969178242cd955ea25f6fd76be7/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:17.013940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.014584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.014893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.054778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] MFA Rules not processed for user `e0fa6969178242cd955ea25f6fd76be7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:17.056186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.079854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:17.158007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1053/2111] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:17.169493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.171772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.247462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.249177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.249843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747ce9a-94b5-4ef9-b094-c510a1f91aac admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:17.269202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:17.270302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.270806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.271186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.281892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:17.283515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:17.295418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1059/2112] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:17.315103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.339465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5337f0-810d-4b73-953a-d41d6600bdd1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:17.344391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:17.345314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.345600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.345873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] PATH_INFO: `/v3/projects/17f60d49361a4fa89f97e551d93cb36f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.347120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f60d49361a4fa89f97e551d93cb36f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:17.350820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:17.443075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f60d49361a4fa89f97e551d93cb36f', 'request_id': 'req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.452874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f60d49361a4fa89f97e551d93cb36f', 'request_id': 'req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.462867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f60d49361a4fa89f97e551d93cb36f', 'request_id': 'req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.479755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2858-1215-490a-b90d-ec546ac988d9 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:17.488265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] The token cache is being invalidate because project 17f60d49361a4fa89f97e551d93cb36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:17.489244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.492354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d0926098-7dc7-4b7d-97f1-03072a2ab6c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.496582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1054/2113] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:17 2022] DELETE /identity/v3/projects/17f60d49361a4fa89f97e551d93cb36f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:17.521662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57797-ba46-4852-a307-50e6427cd797 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.522001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57797-ba46-4852-a307-50e6427cd797 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.522216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57797-ba46-4852-a307-50e6427cd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.574965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bbe57797-ba46-4852-a307-50e6427cd797 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:17.576504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bbe57797-ba46-4852-a307-50e6427cd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.610911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:17.632574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:17.633379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.633937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.634538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:17.634679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] PATH_INFO: `/v3/users/e0fa6969178242cd955ea25f6fd76be7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.637146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fa6969178242cd955ea25f6fd76be7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:17.640166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:17.658295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1055/2114] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:17.667392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.667746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.668097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.690402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:17.691937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.706335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1056/2115] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:17.707600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.721737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7ea09-241d-43e5-a150-6d8a0366d4bc None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:17.727304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:17.728097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.728379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.728654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.729427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:17.729854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:17.731485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:17.734610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fa6969178242cd955ea25f6fd76be7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.736524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fa6969178242cd955ea25f6fd76be7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.763608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1057/2116] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:17.764015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.764958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fa6969178242cd955ea25f6fd76be7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.788286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41c86-301c-4a16-85d2-82cbddd486e0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:17.793624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fa6969178242cd955ea25f6fd76be7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.794980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-786df9cf-4b66-454f-8c2c-2c6f0b5cf1d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fa6969178242cd955ea25f6fd76be7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:17.795722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:17.796438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.796775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.797280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.798046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:17.800359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:17.825765 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1060/2117] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:17 2022] DELETE /identity/v3/users/e0fa6969178242cd955ea25f6fd76be7 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:17.834658 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:17.835020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:17.835213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:17.855990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1058/2118] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:17.856200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:17.856960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.857910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.861311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.982419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1061/2119] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:17.994952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:17.997292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:17.999768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef0e45-eac5-460d-be53-3408756f3577 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.008781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.008781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.008781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.008781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.009285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.010017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.057147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1059/2120] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:17 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:18.059841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.072398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bee24-bf55-4a74-aa11-750cc02cdb77 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.077371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.078185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.078779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.078779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.079450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.081101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.095278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1060/2121] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:18.098326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62fe59-42ad-41e0-83eb-607388ceac6f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.099821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.109714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.110492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.112165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.112539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.121485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741585e-40c1-4009-9503-275b4f22f06e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.129336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.129822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.130574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.131169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.131727 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.132284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.132864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.134786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4b7f23-fa85-4411-bc54-438cbde5b623 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.148157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1062/2122] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:18.158857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1061/2123] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:18.163332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.180693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154444d-19bf-4515-bea7-8e0641d3a168 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.209908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.211027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.211294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.211572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] PATH_INFO: `/v3/projects/43936a0ce3214c3f823fa0269cd536ea/users/654bac0e8faf4a0d9c53b3ef1ae6f4ec/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.254137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43936a0ce3214c3f823fa0269cd536ea, user_id=654bac0e8faf4a0d9c53b3ef1ae6f4ec, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.259975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.263760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:18.297525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1063/2124] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:18 2022] PUT /identity/v3/projects/43936a0ce3214c3f823fa0269cd536ea/users/654bac0e8faf4a0d9c53b3ef1ae6f4ec/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:18.309123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.309673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.309673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.352201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] MFA Rules not processed for user `654bac0e8faf4a0d9c53b3ef1ae6f4ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:18.353666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.459014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1062/2125] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:18.469054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.538181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca1fa-23ce-4982-860e-81eef573bce6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.544595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.545495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.545495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.545840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.546746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.549055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.574695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.576235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.582927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1064/2126] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:18.585287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:18.587092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.592235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032c6f2-ab99-4d21-851e-fd73d6615b6e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.657903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.658785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.659064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.659337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] PATH_INFO: `/v3/projects/5262807271604083b54f93d8cddce7a8` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.661249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5262807271604083b54f93d8cddce7a8)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.663659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.679212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9269af-fe10-4499-a925-c5ad47f90a23 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.685236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.686756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.686756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.687328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.688886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.691778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.715648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1065/2127] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:18.716754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.717275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5262807271604083b54f93d8cddce7a8', 'request_id': 'req-5db5fe02-bdad-488a-9e4e-4634ff54426b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:18.723708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5262807271604083b54f93d8cddce7a8', 'request_id': 'req-5db5fe02-bdad-488a-9e4e-4634ff54426b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:18.727421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b9ecf-ce8a-4f55-92f9-894310a6e433 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.730316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5262807271604083b54f93d8cddce7a8', 'request_id': 'req-5db5fe02-bdad-488a-9e4e-4634ff54426b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:18.745506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] The token cache is being invalidate because project 5262807271604083b54f93d8cddce7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:18.745806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:18.746616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5db5fe02-bdad-488a-9e4e-4634ff54426b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:18.749313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1063/2128] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:18 2022] DELETE /identity/v3/projects/5262807271604083b54f93d8cddce7a8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:18.753957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610b9f-a1a4-408f-a237-b4e67b36cd8e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.754268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610b9f-a1a4-408f-a237-b4e67b36cd8e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.754542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05610b9f-a1a4-408f-a237-b4e67b36cd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.773206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-05610b9f-a1a4-408f-a237-b4e67b36cd8e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:18.774414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-05610b9f-a1a4-408f-a237-b4e67b36cd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.791026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.791786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.792074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.792345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.793118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.794729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.807809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1066/2129] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:18.808886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.810573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.820060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:18.824663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8b24-d79b-4eee-8941-3068e9c32058 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.833679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.834615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.834896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.835169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1064/2130] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:18.835280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.835905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.837591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.842591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.842880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.843150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.848543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1067/2131] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:18.852484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.862143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:18.863333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851749d0-717a-48ed-9788-c48209f03938 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.863520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.868703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.869616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.869896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.870169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] PATH_INFO: `/v3/projects/1722a2a0a5fb4f92b9db9a3848d16343/users/8d3cb15635fa4c1db848a6ddf98d2365/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.871728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1065/2132] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:18.875671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.884870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a1259-fe5c-4280-a158-2d837d70d9ab None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.886096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1722a2a0a5fb4f92b9db9a3848d16343, user_id=8d3cb15635fa4c1db848a6ddf98d2365, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.888816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2c7ed-bc86-45e4-b7f3-200bada7a5b0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.889461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.890109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.890389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.890661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.891383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:18.891684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.893408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:18.906507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1066/2133] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:18.910804 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1068/2134] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:18 2022] PUT /identity/v3/projects/1722a2a0a5fb4f92b9db9a3848d16343/users/8d3cb15635fa4c1db848a6ddf98d2365/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:18.911016 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:18.920912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.921201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.921509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.921602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16937907-b77f-4187-baa2-9e91d7577313 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:18.931439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:18.949598 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] MFA Rules not processed for user `8d3cb15635fa4c1db848a6ddf98d2365`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:18.950827 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:18.983161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:18.983841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:18.984120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:18.984383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:18.985142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:18.987065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.023594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1069/2135] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:19.027605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.027745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1067/2136] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:18 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:19.028889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.039684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa868dd5-de6c-46ce-8cc7-7d7b760b8241 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.108964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44112df6-174a-4fd3-9562-56096112dc61 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.119119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.119823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.120209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.120491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.120579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.121238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.121353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.121517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.121789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.122495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.123222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.124389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.147819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1068/2137] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:19.152114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.156499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1070/2138] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:19.160868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.165152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8c9f9-6a8c-4906-90a4-a9fa69908902 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.214196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:19.227497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.228171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.228450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.228736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.229515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.231192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.233907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d58041-dade-47de-84ad-5a6fd07bb09f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.238688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.239364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.239649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.239925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.241230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.241390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1069/2139] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:19.243161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.245520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.257050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43aff-b6ec-409e-9be6-d1d58e53e067 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.262876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.263966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.264377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.264649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.265520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.267063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.268915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1071/2140] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:19.273181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.277688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1070/2141] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:19.281601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.283915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82990915-267c-4aa7-9f56-d209f5368df6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.289774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.290436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.290721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.290999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.291241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c4978-1130-498e-a972-eb2b38112b5e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.291732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.293378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.295948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.296836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.297120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.297394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] PATH_INFO: `/v3/projects/62b40715ced040f48274d12fa8fc5f6b/users/4fef33d0a6324c4182760fa425d6b2a2/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.307009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1072/2142] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:19.308211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.309218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:19.314881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b40715ced040f48274d12fa8fc5f6b, user_id=4fef33d0a6324c4182760fa425d6b2a2, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.317613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac8b30-20ac-4f44-86b0-f8aa9162e57c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.318712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afec90-e632-41f9-81af-2aa608a048d4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.324671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.325795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.326142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.326520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] PATH_INFO: `/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473/users/9d08eb4a6ad04b15a1cc924980c05abc/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.334208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1071/2143] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:19 2022] PUT /identity/v3/projects/62b40715ced040f48274d12fa8fc5f6b/users/4fef33d0a6324c4182760fa425d6b2a2/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:19.344010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0c7bb777b4268b018bcb1e1b25473, user_id=9d08eb4a6ad04b15a1cc924980c05abc, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.344325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.344619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.344929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.346703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.361703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1073/2144] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:19 2022] PUT /identity/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473/users/9d08eb4a6ad04b15a1cc924980c05abc/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:19.365825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.372038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] MFA Rules not processed for user `4fef33d0a6324c4182760fa425d6b2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:19.373448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.430854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b6738-c241-47a9-b06e-782041b7059b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.435581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.436253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.436542 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.436883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.437614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.439531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.451414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1072/2145] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:19.454208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1074/2146] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:19.456085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.458612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.467954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b14e8d-d96c-4a0e-a76a-218940d6824f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.469800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9aed0-2783-43bf-ae51-ffba31342f72 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.472580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.473288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.473572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.473850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.474716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.477262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.478503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.479682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.480084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.480447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] PATH_INFO: `/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473/users/9d08eb4a6ad04b15a1cc924980c05abc/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.483175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee0c7bb777b4268b018bcb1e1b25473, user_id=9d08eb4a6ad04b15a1cc924980c05abc, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.486258 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6b108-f3c9-41df-ad6a-2b37725ad178 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.501133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1075/2147] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:19 2022] PUT /identity/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473/users/9d08eb4a6ad04b15a1cc924980c05abc/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:19.513567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.513945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.514320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.527921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1073/2148] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:19.528847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.547829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] MFA Rules not processed for user `9d08eb4a6ad04b15a1cc924980c05abc`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:19.549210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.605415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d3f26-fecf-48e8-b248-7e2361912111 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.612451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.613339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.613742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.614021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.615254 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.617863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.637470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1076/2149] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:19.644770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1074/2150] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:19.649236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.650698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.652858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.665764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa89ff-85b2-4e03-a3d6-9084adf3f7fa None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.675995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.676817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.677194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.677691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.678532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.680415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.682333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:19.701139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1077/2151] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:19.709862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.721698 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49398db-0523-4bff-8eb2-8245fbcbfcab admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.728119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.729051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.729337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.729613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] PATH_INFO: `/v3/projects/d10ed00b72354ba99841b4ff98982d46/users/db0d276db9ad4574988157adbc106f0c/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.733108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:19.738435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd79ca-a7a2-4027-8141-5bb285be4939 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.743564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.744389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.744859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.745145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.748978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10ed00b72354ba99841b4ff98982d46, user_id=db0d276db9ad4574988157adbc106f0c, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.752023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.760839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.762446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.770379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1078/2152] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:19 2022] PUT /identity/v3/projects/d10ed00b72354ba99841b4ff98982d46/users/db0d276db9ad4574988157adbc106f0c/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:19.774178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.774743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1075/2153] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:19.821315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.822872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.838672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91e54-47b3-4c4d-b14b-21784137d205 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.858582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099ea43-6ce3-4438-87fe-7270c112c86f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.863562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.864670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.865044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.865337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.866507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.868118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.882613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1079/2154] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:19.884061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:19.894178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5adf37-1d39-4316-996a-b75f6378a183 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:19.894600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.895255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.895534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.895801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.897644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.899022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:19.899907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.900191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.900466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] PATH_INFO: `/v3/projects/d10ed00b72354ba99841b4ff98982d46/users/db0d276db9ad4574988157adbc106f0c/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.902493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10ed00b72354ba99841b4ff98982d46, user_id=db0d276db9ad4574988157adbc106f0c, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.905167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e8a2b-157a-4b8f-856c-e453e8b765d7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.915632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1080/2155] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:19 2022] PUT /identity/v3/projects/d10ed00b72354ba99841b4ff98982d46/users/db0d276db9ad4574988157adbc106f0c/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:19.926634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:19.926928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:19.927205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:19.955214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] MFA Rules not processed for user `db0d276db9ad4574988157adbc106f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:19.956395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:19.961148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:19.962628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:19.972312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1076/2156] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:20.030577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1081/2157] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:20.042115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:20.050895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3db759-f85a-414e-ab54-3959cacb1ebe service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:20.110303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:20.110971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:20.111652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:20.111652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:20.175467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:20.177330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:20.181267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:20.188238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1077/2158] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:23.892643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:23.946148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:23.980646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fade131-9a8b-4401-b2b2-96035251adb9 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:23.986227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:23.987259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:23.987708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:23.988148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] PATH_INFO: `/v3/users/4fef33d0a6324c4182760fa425d6b2a2` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:23.990270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fef33d0a6324c4182760fa425d6b2a2)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:23.992568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:24.079832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fef33d0a6324c4182760fa425d6b2a2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.080633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fef33d0a6324c4182760fa425d6b2a2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.114339 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fef33d0a6324c4182760fa425d6b2a2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.131248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fef33d0a6324c4182760fa425d6b2a2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.131248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8185fb4e-cc7a-4eca-a55c-2b625328844e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fef33d0a6324c4182760fa425d6b2a2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.132706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:24.145251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1082/2159] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:23 2022] DELETE /identity/v3/users/4fef33d0a6324c4182760fa425d6b2a2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:24.149580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:24.149830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8925a7-32c1-4b1c-bca3-6fa30f1f60b8 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:24.150087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:24.150477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:24.179854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:24.182333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:24.226518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:24.227324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:24.227609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:24.228519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] PATH_INFO: `/v3/users/654bac0e8faf4a0d9c53b3ef1ae6f4ec` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:24.231192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654bac0e8faf4a0d9c53b3ef1ae6f4ec)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:24.233190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:24.305657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1083/2160] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:24.317668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:24.319479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:24.321598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654bac0e8faf4a0d9c53b3ef1ae6f4ec'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.322308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654bac0e8faf4a0d9c53b3ef1ae6f4ec'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.322919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654bac0e8faf4a0d9c53b3ef1ae6f4ec'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.339467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654bac0e8faf4a0d9c53b3ef1ae6f4ec'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.359397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6c95b9c5-37e6-4de5-adc6-209d1cd7a321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654bac0e8faf4a0d9c53b3ef1ae6f4ec'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:24.378377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1078/2161] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:24 2022] DELETE /identity/v3/users/654bac0e8faf4a0d9c53b3ef1ae6f4ec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:24.384385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:24.388824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:24.390326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:24.406834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8abfc8-1985-41ff-a1b2-63dc4163835d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:24.418285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:24.420924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:24.430759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:24.504918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:24.505627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:24.505911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:24.506191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:24.508259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:24.529586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1079/2162] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:24.546154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:24.548661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:24.566156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b1249-999e-4a8b-a17c-1b0e6791cca4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:24.572959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:24.573850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:24.574397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:24.574858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:24.590771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:24.592248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:24.596487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:24.598096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:24.609766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1080/2163] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:24.611721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1084/2164] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:25.149899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:25.151927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:25.168057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:25.169838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:25.170382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:25.176041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8935de-b6df-4585-acc4-8e92611e5481 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:25.185126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364e098-20eb-44b6-8ce6-dd3aedab047d service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:25.190690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:25.191640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:25.191923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:25.192194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] PATH_INFO: `/v3/projects/62b40715ced040f48274d12fa8fc5f6b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:25.193564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b40715ced040f48274d12fa8fc5f6b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:25.194479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:25.195491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:25.197885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:25.198607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:25.198966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] PATH_INFO: `/v3/projects/43936a0ce3214c3f823fa0269cd536ea` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:25.202473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43936a0ce3214c3f823fa0269cd536ea)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:25.217210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:25.269618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b40715ced040f48274d12fa8fc5f6b', 'request_id': 'req-7e5f6606-a5de-413f-be86-e4963d9e2f43'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.279135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b40715ced040f48274d12fa8fc5f6b', 'request_id': 'req-7e5f6606-a5de-413f-be86-e4963d9e2f43'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.287916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b40715ced040f48274d12fa8fc5f6b', 'request_id': 'req-7e5f6606-a5de-413f-be86-e4963d9e2f43'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.319892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] The token cache is being invalidate because project 62b40715ced040f48274d12fa8fc5f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:25.320192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.321087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.323396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1085/2165] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:25 2022] DELETE /identity/v3/projects/62b40715ced040f48274d12fa8fc5f6b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:25.327524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:25.329295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:25.344498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43936a0ce3214c3f823fa0269cd536ea', 'request_id': 'req-5833000c-fdd3-4cff-b715-fe7b63b2a25f'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.356177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43936a0ce3214c3f823fa0269cd536ea', 'request_id': 'req-5833000c-fdd3-4cff-b715-fe7b63b2a25f'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.364156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43936a0ce3214c3f823fa0269cd536ea', 'request_id': 'req-5833000c-fdd3-4cff-b715-fe7b63b2a25f'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.383194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] The token cache is being invalidate because project 43936a0ce3214c3f823fa0269cd536ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:25.383702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.385236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.388071 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1081/2166] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:25 2022] DELETE /identity/v3/projects/43936a0ce3214c3f823fa0269cd536ea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:25.395307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:25.396935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:25.424347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5f6606-a5de-413f-be86-e4963d9e2f43 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:25.489727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:25.500123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833000c-fdd3-4cff-b715-fe7b63b2a25f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:25.506503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:25.507587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:25.507910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:25.508397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] PATH_INFO: `/v3/users/8d3cb15635fa4c1db848a6ddf98d2365` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:25.511092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3cb15635fa4c1db848a6ddf98d2365)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:25.513886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:25.514379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:25.515462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:25.515775 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:25.516372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] PATH_INFO: `/v3/users/db0d276db9ad4574988157adbc106f0c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:25.518270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0d276db9ad4574988157adbc106f0c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:25.520994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:25.602089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0d276db9ad4574988157adbc106f0c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.602694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0d276db9ad4574988157adbc106f0c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.605709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3cb15635fa4c1db848a6ddf98d2365'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.607261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3cb15635fa4c1db848a6ddf98d2365'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.608543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3cb15635fa4c1db848a6ddf98d2365'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.635229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3cb15635fa4c1db848a6ddf98d2365'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.650318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0d276db9ad4574988157adbc106f0c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.667989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0d276db9ad4574988157adbc106f0c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.667989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0d276db9ad4574988157adbc106f0c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.668388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3cb15635fa4c1db848a6ddf98d2365'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:25.679444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1082/2167] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:25 2022] DELETE /identity/v3/users/8d3cb15635fa4c1db848a6ddf98d2365 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:25.688646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1086/2168] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:25 2022] DELETE /identity/v3/users/db0d276db9ad4574988157adbc106f0c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:25.895874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:25.897748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:25.918420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:26.054011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d0e30-3a6e-4fdc-83cb-0c7b86504943 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.147704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.148822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.149142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.149445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] PATH_INFO: `/v3/users/b2d3648298fe4175a04e9dda9d7e6310` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.150973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d3648298fe4175a04e9dda9d7e6310)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.153157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.261092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d3648298fe4175a04e9dda9d7e6310'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.269266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d3648298fe4175a04e9dda9d7e6310'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.273255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.274826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.278355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d3648298fe4175a04e9dda9d7e6310'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.292906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d3648298fe4175a04e9dda9d7e6310'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.304036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8f584-4b88-456f-964b-23ea33ad2720 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.310684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.311893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.312277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.312744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] PATH_INFO: `/v3/projects/d10ed00b72354ba99841b4ff98982d46` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.315402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10ed00b72354ba99841b4ff98982d46)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.317428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.325672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0df002c2-742d-4726-a0c6-7285d8e75f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d3648298fe4175a04e9dda9d7e6310'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.352677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1083/2169] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:25 2022] DELETE /identity/v3/users/b2d3648298fe4175a04e9dda9d7e6310 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:26.354428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.354760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.355080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.377787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:26.379129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.390014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10ed00b72354ba99841b4ff98982d46', 'request_id': 'req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.399164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10ed00b72354ba99841b4ff98982d46', 'request_id': 'req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.410215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10ed00b72354ba99841b4ff98982d46', 'request_id': 'req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.422308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:26.431771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] The token cache is being invalidate because project d10ed00b72354ba99841b4ff98982d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:26.432145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.433262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4beabfa4-e39b-4cc0-a039-2bc576b9ae87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.437205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1087/2170] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:26 2022] DELETE /identity/v3/projects/d10ed00b72354ba99841b4ff98982d46 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:26.446253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ddfee-cd3f-46df-9e1d-e062e9c53b66 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.446545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ddfee-cd3f-46df-9e1d-e062e9c53b66 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.446824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ddfee-cd3f-46df-9e1d-e062e9c53b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.473099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1084/2171] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:26.473279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-af6ddfee-cd3f-46df-9e1d-e062e9c53b66 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:26.473279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-af6ddfee-cd3f-46df-9e1d-e062e9c53b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.484695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.487013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.491494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1088/2172] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:26.493299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.493619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.493898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.529821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:26.531632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.544620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1089/2173] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:26.550160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.569014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678dd0c-0e45-4c8d-a60b-9fde561f03a2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.574835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.575511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.575792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.576060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.577386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:26.577706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.579701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.580403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097bfa-fe66-4c6f-b1b8-6a19e13b9855 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.584784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.585664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.585945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.586218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.603700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1090/2174] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:26.604621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.607104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.608639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.613500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.624445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1085/2175] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:26.625545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.629700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10df9d-4154-46d4-a0ca-62fcf5eeefc1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.639914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896b33d-4582-43ab-b6a3-c94ebd0a408a service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.646048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.647512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.647652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.647905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.648189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] PATH_INFO: `/v3/projects/1722a2a0a5fb4f92b9db9a3848d16343` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.648804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.649161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.649632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.650100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1722a2a0a5fb4f92b9db9a3848d16343)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.651513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.652889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.654681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.692620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1086/2176] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:26 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:26.696939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.725920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:26.782032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1722a2a0a5fb4f92b9db9a3848d16343', 'request_id': 'req-976520e0-94d3-4e01-99f4-a15397382bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.793456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1722a2a0a5fb4f92b9db9a3848d16343', 'request_id': 'req-976520e0-94d3-4e01-99f4-a15397382bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.810729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1722a2a0a5fb4f92b9db9a3848d16343', 'request_id': 'req-976520e0-94d3-4e01-99f4-a15397382bd5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.836883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e0ea0-9684-4468-b8ba-a06c5421483b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.840705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] The token cache is being invalidate because project 1722a2a0a5fb4f92b9db9a3848d16343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:26.841223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.842145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:26.844514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1091/2177] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:26 2022] DELETE /identity/v3/projects/1722a2a0a5fb4f92b9db9a3848d16343 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:26.848880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.852776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.920255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.921064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.921555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.921901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.922673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.924747 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:26.933088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:26.952851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1087/2178] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:26 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:26.961599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:26.963738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:26.980018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ef84-fd3d-4af7-be35-f40bfdb2303d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:26.990638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:26.990638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:26.990638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:26.990638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:26.991847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:26.991847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.004055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1088/2179] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:27.014252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.032789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84b4e1-4813-4b52-9197-3fb4804ca1f5 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.049179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.050009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.050388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.050777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.051618 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.053689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.080573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1089/2180] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:27.084522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.086029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976520e0-94d3-4e01-99f4-a15397382bd5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.101858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.102759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.103044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.103317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] PATH_INFO: `/v3/users/9d08eb4a6ad04b15a1cc924980c05abc` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.104690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa824-03d0-48f1-afd7-ed6d4f856d26 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.108132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d08eb4a6ad04b15a1cc924980c05abc)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.110423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.115769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.116887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.117367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.117657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] PATH_INFO: `/v3/projects/97dd99ed2e79420887f3382fecfc85f1/users/48bcb61c9e0244daaa751c76868170e5/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.149428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97dd99ed2e79420887f3382fecfc85f1, user_id=48bcb61c9e0244daaa751c76868170e5, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.152431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca37a13-7369-4672-87c8-6bc1c275c477 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.185590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1090/2181] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:27 2022] PUT /identity/v3/projects/97dd99ed2e79420887f3382fecfc85f1/users/48bcb61c9e0244daaa751c76868170e5/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:27.187323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.187644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.187988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.215358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d08eb4a6ad04b15a1cc924980c05abc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.216378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d08eb4a6ad04b15a1cc924980c05abc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.225182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] MFA Rules not processed for user `48bcb61c9e0244daaa751c76868170e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:27.226738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.253474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d08eb4a6ad04b15a1cc924980c05abc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.265485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d08eb4a6ad04b15a1cc924980c05abc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.268641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d08eb4a6ad04b15a1cc924980c05abc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.299371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1092/2182] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:26 2022] DELETE /identity/v3/users/9d08eb4a6ad04b15a1cc924980c05abc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:27.300880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.302667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.347853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1091/2183] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:27.352401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:27.356434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.360115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.397401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be5f66-8bff-4dbe-bbf1-9107b908a522 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.403965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.403965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.403965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.403965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] PATH_INFO: `/v3/projects/79f425e86544495f8638efc153c63ce1` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.406203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f425e86544495f8638efc153c63ce1)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.408296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.496871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f425e86544495f8638efc153c63ce1', 'request_id': 'req-f874ed3a-6d1d-4081-80ff-c1730a8a48be'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.509615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f425e86544495f8638efc153c63ce1', 'request_id': 'req-f874ed3a-6d1d-4081-80ff-c1730a8a48be'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.527825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0490bc-2f36-47ff-8e33-6e8c9701b50a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.534996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f425e86544495f8638efc153c63ce1', 'request_id': 'req-f874ed3a-6d1d-4081-80ff-c1730a8a48be'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.562709 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] The token cache is being invalidate because project 79f425e86544495f8638efc153c63ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:27.563610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.564219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.570636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1093/2184] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:27 2022] DELETE /identity/v3/projects/79f425e86544495f8638efc153c63ce1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:27.571452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.573922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.631858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:27.655152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.656002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.656397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.657218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.658995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.669726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.694972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ed3a-6d1d-4081-80ff-c1730a8a48be admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.700172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.701288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.701799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.702151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] PATH_INFO: `/v3/users/95db766ba12345429b58e83b9859080b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.703810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=95db766ba12345429b58e83b9859080b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.707736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.720595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1092/2185] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:27 2022] POST /identity/v3/projects => generated 385 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:27.723872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.726294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.776177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95db766ba12345429b58e83b9859080b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.780031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95db766ba12345429b58e83b9859080b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.796250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:27.824202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95db766ba12345429b58e83b9859080b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.836371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95db766ba12345429b58e83b9859080b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.837202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95db766ba12345429b58e83b9859080b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:27.856776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1094/2186] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:27 2022] DELETE /identity/v3/users/95db766ba12345429b58e83b9859080b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:27.857729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adac455-c23c-4dcc-9014-c466b103b615 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.857980 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.859738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.950902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.951636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.951921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.952192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:27.952925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:27.955063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:27.986822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba003c2-8efc-49cf-bbaf-55b71ee467ef admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:27.987041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1093/2187] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:27 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:27.988248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:27.990505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:27.995735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:27.997354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:27.997901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:27.998437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] PATH_INFO: `/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.000057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee0c7bb777b4268b018bcb1e1b25473)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.003885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.004457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43a24b-c211-4d7f-adb4-ca89c1b43ec0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.045471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.048160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.048693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.049302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.051363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.051934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.081489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1094/2188] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:28.085852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.100470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839d8ef-58b8-4edc-9af7-0f28a418f6d0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.118871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee0c7bb777b4268b018bcb1e1b25473', 'request_id': 'req-17772b4a-e53b-4667-8f98-1f2e6b1224d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.126810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee0c7bb777b4268b018bcb1e1b25473', 'request_id': 'req-17772b4a-e53b-4667-8f98-1f2e6b1224d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.136283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee0c7bb777b4268b018bcb1e1b25473', 'request_id': 'req-17772b4a-e53b-4667-8f98-1f2e6b1224d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.159616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] The token cache is being invalidate because project 7ee0c7bb777b4268b018bcb1e1b25473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:28.160032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.169667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:28.170241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-17772b4a-e53b-4667-8f98-1f2e6b1224d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.172769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1095/2189] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:27 2022] DELETE /identity/v3/projects/7ee0c7bb777b4268b018bcb1e1b25473 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:28.175742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.177449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.177752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.178885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.180162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.181938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.182266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72e12-0078-41d4-bebb-6b594a2d45e8 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.182609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72e12-0078-41d4-bebb-6b594a2d45e8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.182890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72e12-0078-41d4-bebb-6b594a2d45e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.203098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1095/2190] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:28.204025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.205911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-28c72e12-0078-41d4-bebb-6b594a2d45e8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:28.206354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.213113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-28c72e12-0078-41d4-bebb-6b594a2d45e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.222546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1096/2191] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:28.222932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecabe0-291e-4925-98fc-6165f52ceeab admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.229150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.230610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.231151 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.231438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] PATH_INFO: `/v3/projects/913da9507c1d4bf1b9c6cc9f889b406e/users/f6462221ad9f4f1d824b3c45e9142192/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.231562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.231884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.232165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.252003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=913da9507c1d4bf1b9c6cc9f889b406e, user_id=f6462221ad9f4f1d824b3c45e9142192, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.252825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:28.254078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.257569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1602a1-026e-49de-a19c-f63feac98fdc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.271289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1097/2192] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:28.272392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.275362 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1096/2193] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:28 2022] PUT /identity/v3/projects/913da9507c1d4bf1b9c6cc9f889b406e/users/f6462221ad9f4f1d824b3c45e9142192/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:28.283565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e329711-7ae6-423d-b86c-f9280dae6ff3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.286936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.287231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.288464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.349671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:28.353984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] MFA Rules not processed for user `f6462221ad9f4f1d824b3c45e9142192`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:28.361772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.367793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.368764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.370691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.371178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.372384 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:28.372929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.375226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.393526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1098/2194] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:28.394402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.396641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.427555 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f2cf2-21fb-4c58-a33c-ee88ea11eebb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.448642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.449813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.450516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.450516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] PATH_INFO: `/v3/projects/4a7aba11580f47ffb0150ee76ace1918` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.451677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7aba11580f47ffb0150ee76ace1918)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.455365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.526270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1097/2195] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:28.526270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.558886 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d628d-974a-4cba-a0c6-8236f67619ca None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.566676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7aba11580f47ffb0150ee76ace1918', 'request_id': 'req-bf8a24c5-af30-4728-9dab-d20d013dd040'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.583941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7aba11580f47ffb0150ee76ace1918', 'request_id': 'req-bf8a24c5-af30-4728-9dab-d20d013dd040'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.593462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7aba11580f47ffb0150ee76ace1918', 'request_id': 'req-bf8a24c5-af30-4728-9dab-d20d013dd040'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.619882 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] The token cache is being invalidate because project 4a7aba11580f47ffb0150ee76ace1918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:28.620088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.621259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:28.626266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1099/2196] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:28 2022] DELETE /identity/v3/projects/4a7aba11580f47ffb0150ee76ace1918 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:28.627213 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.628760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.647357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.648225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.648579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.648996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.650368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.653188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e156b9-86e1-499a-99d6-c623a85372e1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.692127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1098/2197] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:28.694070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.694523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.694967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.716901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:28.718386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.735493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a24c5-af30-4728-9dab-d20d013dd040 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.758120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:28.801804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1099/2198] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:28.803510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.805023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.810179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.811145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.811579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.812001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.813154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.815778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24904f3-0943-461b-9ced-5a68a171d99f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.823289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ee23-1cb1-47e8-9502-a6923dbc8bb2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.829292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.830093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.830321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.830631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.831750 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.834799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.856659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1100/2199] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:28.859283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.859823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.860269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.865041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1100/2200] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/users => generated 291 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:28.868263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:28.875562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:28.891602 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127841cd-29c6-4110-b46d-27fb85ec302a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:28.895722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:28.901111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:28.979793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:28.980326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:28.981259 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:28.981540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:28.982247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:28.984480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:28.988567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1101/2201] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:28.992787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.002868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ce360-e7eb-4381-a7d0-fca86a88ac88 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.010274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1101/2202] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:28 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:29.011146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.025340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb800030-5167-4f8f-becd-04120a13a3e2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.029472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.030435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.030435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.030719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.031474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.033131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.033542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.034226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.035441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.035745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.036514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:29.037227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.038898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.048442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1102/2203] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.048442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.057876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1102/2204] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:29.058693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.059141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de427a4-af3f-45a0-b17f-a0d94d29eba7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.065941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.066449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.066738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.067209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.067890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.069750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.081821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e6ae5-dcbd-4a71-b26d-96c1f8e9e5b9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.081944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1103/2205] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.085843 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.088345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.089105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.089388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.089666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.090392 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.093372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.097174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31b9c6-027f-4438-ad9e-d3d51512a823 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.102784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.103456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.103755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.104021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.105080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.106908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.109767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1103/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.110710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.123270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7c48a-5da5-44b8-a1f6-ac475e4f3408 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.129767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.131930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.132221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.133104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] PATH_INFO: `/v3/projects/d6aa903fabb6468d86ab889d0409d787/users/84ae170d54d043aba5857ffcba43af16/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.145473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1104/2207] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:29 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:29.147318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.155516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa903fabb6468d86ab889d0409d787, user_id=84ae170d54d043aba5857ffcba43af16, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.159593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.180549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1104/2208] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:29 2022] PUT /identity/v3/projects/d6aa903fabb6468d86ab889d0409d787/users/84ae170d54d043aba5857ffcba43af16/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:29.181600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.219412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041123af-df9a-42f8-837e-dfef23691ca3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.259404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258f51e-cadf-4e0b-a173-238d534ee0e2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.272876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.273823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.274107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.274387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.275094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.277089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.288228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:29.309047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1105/2209] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:29 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:29.309047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.316818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.318496 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.318816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.319108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] PATH_INFO: `/v3/projects/7500725f7c744f318862323e13c5f23e/users/ad9a7c6755784828b967f1bef37f6441/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.325119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d81494f-4c73-49fc-8952-e0ec92e66ed0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.330248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.331167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.331570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.331944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.332221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:29.333028 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.336112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.338961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7500725f7c744f318862323e13c5f23e, user_id=ad9a7c6755784828b967f1bef37f6441, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.342909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.357801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1106/2210] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.358680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.373943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1105/2211] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:29 2022] PUT /identity/v3/projects/7500725f7c744f318862323e13c5f23e/users/ad9a7c6755784828b967f1bef37f6441/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:29.374840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.377672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e35be-84ab-437b-9a49-51cb155ce0d5 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.440549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.441116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.441396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.441665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.442643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.444265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.445604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd68a8-ef9c-4d1f-a7b6-a00ee6d936fc admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.458509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1107/2212] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.458509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.461094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.462876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.463961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.464379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.464833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] PATH_INFO: `/v3/projects/d6aa903fabb6468d86ab889d0409d787/users/84ae170d54d043aba5857ffcba43af16/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.467432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6aa903fabb6468d86ab889d0409d787, user_id=84ae170d54d043aba5857ffcba43af16, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.470715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cfbb3f-760c-416d-ac65-2b53ff89e8f9 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.479686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff7f59-6df5-448b-b68f-01f2e4bcfdf1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.485517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1106/2213] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:29 2022] PUT /identity/v3/projects/d6aa903fabb6468d86ab889d0409d787/users/84ae170d54d043aba5857ffcba43af16/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:29.487143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.487585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.488178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.508605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:29.509908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.550869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.551763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.552046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.552355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] PATH_INFO: `/v3/users/75ebe0d05a1c4b66aa3b3abebd0ce026` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.553688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ebe0d05a1c4b66aa3b3abebd0ce026)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.555658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.575111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1107/2214] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:29.576092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.586581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cd159-67ff-4108-bc03-0a2f6bbef602 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.591880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.592972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.593262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.593546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.594534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.596407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c8af6-22ab-41aa-ae7d-c01e018f38a1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.610435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1108/2215] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:29.610596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ebe0d05a1c4b66aa3b3abebd0ce026'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:29.610596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ebe0d05a1c4b66aa3b3abebd0ce026'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:29.610781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.610781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.610943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ebe0d05a1c4b66aa3b3abebd0ce026'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:29.611036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.618715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ebe0d05a1c4b66aa3b3abebd0ce026'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:29.631959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ebe0d05a1c4b66aa3b3abebd0ce026'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:29.637813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] MFA Rules not processed for user `84ae170d54d043aba5857ffcba43af16`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:29.639069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.640509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:29.646309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1108/2216] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:29 2022] DELETE /identity/v3/users/75ebe0d05a1c4b66aa3b3abebd0ce026 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:29.647472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.653936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.709253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:29.720514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1109/2217] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:29.720514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.720514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.725094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be161a-d28b-4b44-a66e-fd705eaee430 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.729302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.730195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.730592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.730991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.733524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.739189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7aba5c-6141-4a0c-9fb4-fd1e5e7d6cad None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.807299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.809439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.809991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.810275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] PATH_INFO: `/v3/projects/399775a3879d4a79abd01feb37fbae79/users/a24b6514368c4c2d8e6003cbef164704/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.810734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.812696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.825954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1109/2218] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:29.826810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.828483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=399775a3879d4a79abd01feb37fbae79, user_id=a24b6514368c4c2d8e6003cbef164704, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.829436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.835970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.864386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1110/2219] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:29 2022] PUT /identity/v3/projects/399775a3879d4a79abd01feb37fbae79/users/a24b6514368c4c2d8e6003cbef164704/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:29.874167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:29.875934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.913181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021450e-15fa-48b2-8a94-28cab6bdf5b1 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.953762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21589-78e1-46e7-a02f-863e2b08c942 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:29.962080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.963116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.963516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.964023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] PATH_INFO: `/v3/projects/361bd83b835c4ec3b01a1173b2d9cb1d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.965614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=361bd83b835c4ec3b01a1173b2d9cb1d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:29.967936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:29.969784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:29.970375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:29.970657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:29.971593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:29.973780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:29.996862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:30.039227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361bd83b835c4ec3b01a1173b2d9cb1d', 'request_id': 'req-c6f3772d-30e7-49fa-8db0-d0588aab8a30'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:30.046631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361bd83b835c4ec3b01a1173b2d9cb1d', 'request_id': 'req-c6f3772d-30e7-49fa-8db0-d0588aab8a30'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:30.052536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.053400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361bd83b835c4ec3b01a1173b2d9cb1d', 'request_id': 'req-c6f3772d-30e7-49fa-8db0-d0588aab8a30'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:30.054498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd538bb-40ed-4fa5-b36d-76fa0edc4e82 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.065573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1110/2220] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:30.067032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.067356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.067633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.078393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] The token cache is being invalidate because project 361bd83b835c4ec3b01a1173b2d9cb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:30.079111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:30.079879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c6f3772d-30e7-49fa-8db0-d0588aab8a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:30.082520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1111/2221] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:29 2022] DELETE /identity/v3/projects/361bd83b835c4ec3b01a1173b2d9cb1d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:30.087582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f36899-b4ee-406b-89bb-34acf4ae9ead None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.089110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f36899-b4ee-406b-89bb-34acf4ae9ead None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.089740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f36899-b4ee-406b-89bb-34acf4ae9ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.114035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-08f36899-b4ee-406b-89bb-34acf4ae9ead None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:30.115533 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-08f36899-b4ee-406b-89bb-34acf4ae9ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:30.123865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:30.125859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] MFA Rules not processed for user `a24b6514368c4c2d8e6003cbef164704`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:30.129675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:30.257717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1111/2222] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:30.262551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.263304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1112/2223] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:30.266803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:30.273661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.274112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.274521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.299004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8b35-04f5-44d6-9e08-bda93b58afb1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.310781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:30.311719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.312426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.312664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:30.312801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.313013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.314455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.319239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.327585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1113/2224] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:30.331509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.353940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2406e9f-7f48-4fd7-bfd7-90438193506c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.360359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.361205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.361577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.361868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.362883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:30.363286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.366381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.375541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1112/2225] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:30.393325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1114/2226] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:30.400991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.411141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.455357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023e3d9-2a99-4ae4-9ee5-1be3adbadca3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.548182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a293b63-2625-4aa6-a5ff-7c103d4b4537 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.558204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.559672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.560238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.560238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.560963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.564061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.602236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.602745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1113/2227] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/users => generated 296 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:30.606217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.606780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.607084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.607365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.608081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.610104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.633452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbbe883-482c-411a-863d-d5f26c2824ac admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.647759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.648637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.648997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.649319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.649810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1115/2228] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/projects => generated 389 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:30.650845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.655511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.657414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.672515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1114/2229] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:30.677073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.687188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:30.693112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b926cc-2106-4ea7-ae38-981bc08459a6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.734721 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9930e68-176a-4719-ac9f-b40b9b180feb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.740270 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.740986 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.741269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.741554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.742260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.744205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.776891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1116/2230] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:30 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:30.778053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.781208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.782138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.782422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.782697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] PATH_INFO: `/v3/projects/6050969a41774001a5060507f24041ca/users/c0ab0717a9b2450c84402ba6fc0c9f3a/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.791969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca729856-e6e9-452d-8b0f-dbb46d44781a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.799062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.799756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.800039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.800316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.800975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6050969a41774001a5060507f24041ca, user_id=c0ab0717a9b2450c84402ba6fc0c9f3a, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.801098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.802807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.804473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.804613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:30.825148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1115/2231] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:30 2022] PUT /identity/v3/projects/6050969a41774001a5060507f24041ca/users/c0ab0717a9b2450c84402ba6fc0c9f3a/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:30.826161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1117/2232] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:30.826285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.828265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.840860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4310d8-f1c3-4fa8-87fa-691c208443e2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.917359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc820d99-c861-40fb-b492-a117e58305d7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.925745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.926444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.926734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.927014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.927819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.930441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.936881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.939289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.939687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.940060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.941358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.944257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.947790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1116/2233] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:30.953757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.959905 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1118/2234] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:30.961424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:30.971184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9ebb6-5498-43db-85a9-2175139aaa62 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.981843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.982776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1076eb-271c-4647-8f3a-13a1831785f9 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:30.984631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.984960 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.985243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] PATH_INFO: `/v3/projects/6050969a41774001a5060507f24041ca/users/c0ab0717a9b2450c84402ba6fc0c9f3a/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:30.987463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6050969a41774001a5060507f24041ca, user_id=c0ab0717a9b2450c84402ba6fc0c9f3a, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:30.989234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:30.990372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5e7e9-3057-4429-992f-24ab7436ddbc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:30.990763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:30.991049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:30.991328 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] PATH_INFO: `/v3/projects/a98f7478c9384ee298321a1506aa0bde/users/69c4f81285904da78e96a4a515ec2cb2/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.008337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1117/2235] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:30 2022] PUT /identity/v3/projects/6050969a41774001a5060507f24041ca/users/c0ab0717a9b2450c84402ba6fc0c9f3a/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:31.029507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.029929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.030380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.037043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98f7478c9384ee298321a1506aa0bde, user_id=69c4f81285904da78e96a4a515ec2cb2, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:31.039994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444fda4f-c891-4383-9261-272685f60476 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:31.058617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1119/2236] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:30 2022] PUT /identity/v3/projects/a98f7478c9384ee298321a1506aa0bde/users/69c4f81285904da78e96a4a515ec2cb2/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:31.067492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.069051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.072146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.075657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] MFA Rules not processed for user `c0ab0717a9b2450c84402ba6fc0c9f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:31.077591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:31.103440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:31.105398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:31.167242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:31.188758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1118/2237] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:31.188989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1120/2238] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:31.197360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:31.199258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:31.203080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:31.204914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:31.276764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3029fa-e57f-40c8-acd6-e64094737d10 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:31.281804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:31.282728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.283158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.283575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.298526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:31.299988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de92e94-9048-4348-b9e3-240b38f3326a service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:31.311166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c063a9a-db49-4ee0-ae5f-0cc5aae3b287 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:31.311777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1119/2239] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:31.315340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:31.316212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.316568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.316936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.329540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:31.331075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:31.344191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1121/2240] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:31.821429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.821790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.822143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.871434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] MFA Rules not processed for user `a4a159cc0128485482851c885de78e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:31.877506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:31.913630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:31.930332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd82716-49f3-4204-9ec6-24b5fec43838 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:31.939942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0ab0717a9b2450c84402ba6fc0c9f3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6050969a41774001a5060507f24041ca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:31.940739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:31.941190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:31.942114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:31.943311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:31.943961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:31.950021 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:31.971101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1122/2241] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:31.972236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:31.976687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:32.003127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e6cd4-18b8-4430-a63a-210f9f30276b tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:32.010798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0ab0717a9b2450c84402ba6fc0c9f3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6050969a41774001a5060507f24041ca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:32.012085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:32.013590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:32.014209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:32.015729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:32.025987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:32.043097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1120/2242] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:32.082733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1123/2243] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:31 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:32.086427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:32.087889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:32.088624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:32.105276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6f0f2-0cb4-468a-bd94-9e48c37bded2 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:32.194404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:32.196030 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:32.196319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:32.196597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:32.198598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:32.269860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2151-c403-46c0-a400-2c303b556753 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:32.284573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0ab0717a9b2450c84402ba6fc0c9f3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6050969a41774001a5060507f24041ca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:32.285297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:32.285587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:32.285870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:32.286729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:32.287048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:32.288829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:32.293535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:32.295024 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:32.299497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:32.315902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1121/2244] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:32.323828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1124/2245] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:32.401123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:32.449940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5c81-3564-4549-a3c3-b877d099d4de service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:32.468803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0ab0717a9b2450c84402ba6fc0c9f3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6050969a41774001a5060507f24041ca', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:32.469662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:32.470400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:32.471872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] PATH_INFO: `/v3/projects/d29f278ca188450b8b4e5c00f576c32d` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:32.476205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d29f278ca188450b8b4e5c00f576c32d)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:32.484304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:32.567019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29f278ca188450b8b4e5c00f576c32d', 'request_id': 'req-374e3931-4e2c-4984-86a8-37e00273df88'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:32.579203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29f278ca188450b8b4e5c00f576c32d', 'request_id': 'req-374e3931-4e2c-4984-86a8-37e00273df88'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:32.589967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29f278ca188450b8b4e5c00f576c32d', 'request_id': 'req-374e3931-4e2c-4984-86a8-37e00273df88'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:32.629641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] The token cache is being invalidate because project d29f278ca188450b8b4e5c00f576c32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:32.633096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:32.635608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:32.642308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1122/2246] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:32 2022] DELETE /identity/v3/projects/d29f278ca188450b8b4e5c00f576c32d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:33.214173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:33.218457 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:33.463485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:33.465536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:33.496199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1b19-7612-440b-aa39-07256e53819d tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:33.627310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e3931-4e2c-4984-86a8-37e00273df88 tempest-VolumeQuotaClassesTest-109762767 tempest-VolumeQuotaClassesTest-109762767-project-admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:33.642845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:33.646269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:33.648573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:33.648904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:33.653433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:33.694676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:33.695545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:33.696105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:33.696389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] PATH_INFO: `/v3/users/a24b6514368c4c2d8e6003cbef164704` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:33.700135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24b6514368c4c2d8e6003cbef164704)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:33.703593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:33.788193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:33.878276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24b6514368c4c2d8e6003cbef164704'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:33.879426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24b6514368c4c2d8e6003cbef164704'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:33.891685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:33.893557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6579d-1e26-4e01-8587-251350f06da1 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:33.909393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24b6514368c4c2d8e6003cbef164704'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:33.935727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24b6514368c4c2d8e6003cbef164704'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:33.936521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24b6514368c4c2d8e6003cbef164704'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:33.942504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1123/2247] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:33.969569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1125/2248] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:33 2022] DELETE /identity/v3/users/a24b6514368c4c2d8e6003cbef164704 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:33.974893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:33.975176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:33.975285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:34.036557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:34.038201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:34.122049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:34.202608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1124/2249] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:34.217202 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:34.218347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:34.369727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57755367-f3c8-4b28-94d9-829c64127765 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:34.375230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:34.376607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:34.377088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:34.377498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:34.393290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:34.395062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:34.415923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1126/2250] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:35.170520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:35.172076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:35.194434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf411243-545e-47f8-859e-b1bf2e7685eb None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:35.204910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:35.205802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:35.206133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:35.206403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] PATH_INFO: `/v3/projects/399775a3879d4a79abd01feb37fbae79` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:35.209772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399775a3879d4a79abd01feb37fbae79)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:35.211743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:35.314186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399775a3879d4a79abd01feb37fbae79', 'request_id': 'req-ca31fa5c-2b97-4183-ab70-59e10858dea0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.332373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399775a3879d4a79abd01feb37fbae79', 'request_id': 'req-ca31fa5c-2b97-4183-ab70-59e10858dea0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.348159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399775a3879d4a79abd01feb37fbae79', 'request_id': 'req-ca31fa5c-2b97-4183-ab70-59e10858dea0'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.370585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] The token cache is being invalidate because project 399775a3879d4a79abd01feb37fbae79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:35.371181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.374019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.376880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1125/2251] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:35 2022] DELETE /identity/v3/projects/399775a3879d4a79abd01feb37fbae79 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:35.382337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:35.397301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c125a-feeb-4a9c-a0b4-54b960123630 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:35.507413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:35.508761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:35.509187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:35.510378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] PATH_INFO: `/v3/users/c0ab0717a9b2450c84402ba6fc0c9f3a` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:35.511865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ab0717a9b2450c84402ba6fc0c9f3a)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:35.514195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:35.645171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:35.658936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ab0717a9b2450c84402ba6fc0c9f3a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.662196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ab0717a9b2450c84402ba6fc0c9f3a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.728577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ab0717a9b2450c84402ba6fc0c9f3a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.756480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ab0717a9b2450c84402ba6fc0c9f3a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.757392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f2f85198-0f4c-41be-9de8-a92e263ada8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ab0717a9b2450c84402ba6fc0c9f3a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:35.804941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1127/2252] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:35 2022] DELETE /identity/v3/users/c0ab0717a9b2450c84402ba6fc0c9f3a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:36.962389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:36.963898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:37.015708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31fa5c-2b97-4183-ab70-59e10858dea0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:37.170821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:37.172015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:37.172518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:37.173036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] PATH_INFO: `/v3/projects/6050969a41774001a5060507f24041ca` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:37.176749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6050969a41774001a5060507f24041ca)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:37.179787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:37.286773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6050969a41774001a5060507f24041ca', 'request_id': 'req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:37.300017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6050969a41774001a5060507f24041ca', 'request_id': 'req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:37.303610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:37.313721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6050969a41774001a5060507f24041ca', 'request_id': 'req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:37.340477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] The token cache is being invalidate because project 6050969a41774001a5060507f24041ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:37.340990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:37.343266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7abb1fa-fa3d-4132-8dd8-4ecaae26b7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:37.356809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1126/2253] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:36 2022] DELETE /identity/v3/projects/6050969a41774001a5060507f24041ca => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:37.357036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:37.357036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:37.357036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:37.404472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:37.413420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:37.577416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:37.577941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:37.578064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1128/2254] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:37.578356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:37.617942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:37.619385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:37.639872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1127/2255] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:37.640349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:37.654585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c60780-cd92-4630-9c50-3728f02de4c7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:37.680961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:37.681886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:37.682172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:37.682447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:37.685789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:37.686118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:37.690967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:37.723527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1129/2256] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:37.729594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:37.745969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f42087-2d09-4e09-aa95-72b3f5aaf794 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:37.761124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:37.761907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:37.762195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:37.762518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:37.763237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:37.765380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:37.829954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1128/2257] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:37 2022] POST /identity/v3/projects => generated 399 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:37.834736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:37.854703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720c16c-4d76-4d9e-9a91-d4eaab3cbbf2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.000652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.001563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.002124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.002549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.003925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.011283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.065226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1130/2258] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:37 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:38.066138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.094881 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26d22e-b774-406d-9672-5e7720809abd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.109460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.115483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.116010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.116442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.117540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.120496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984a03f-1526-4da0-99d8-db498c1546e0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.165001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1129/2259] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:38.166799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.181718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cefc1-b2a6-49cc-ba2f-9687bfc1765b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.201495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.202196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.202490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.213140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.213140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.213140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.219060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.219355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.219689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.224862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1131/2260] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:38.227300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.241759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919ee7d-ae7a-4136-a2c4-89c50e8e2d0c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.248977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.250268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.250962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.252150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] PATH_INFO: `/v3/projects/92f6e708f5f74957b064a1b2ffa2a8c5/users/dc92fac8922c469684f59fbb316b76df/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.291835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f6e708f5f74957b064a1b2ffa2a8c5, user_id=dc92fac8922c469684f59fbb316b76df, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.293332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] MFA Rules not processed for user `ad9a7c6755784828b967f1bef37f6441`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:38.295977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:38.298593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ff220-f2e2-44f9-b245-fbe67d8c9dde admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.312194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:38.328452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1132/2261] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:38 2022] PUT /identity/v3/projects/92f6e708f5f74957b064a1b2ffa2a8c5/users/dc92fac8922c469684f59fbb316b76df/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:38.340142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.340428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.341146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.379032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] MFA Rules not processed for user `dc92fac8922c469684f59fbb316b76df`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:38.380661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:38.472319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1130/2262] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:38.478554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.479985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:38.517124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362eb82-07b7-4965-969a-8d245bdfc687 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.550732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1133/2263] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:38.556411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.689396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.690177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.690535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.690883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.691719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.694920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.766196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1131/2264] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:38 2022] POST /identity/v3/projects => generated 385 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:38.767874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:38.796378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bf10d-d629-47f0-a888-2b683ce655eb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.815900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:38.926929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d5e79-9939-4d24-820e-e07ca27d36e0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:38.931998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.933178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.933867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.933867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.939348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.942481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:38.943349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:38.943636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:38.943906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:38.948267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:38.950442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.960150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:38.991282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1132/2265] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:38 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:38.993380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.016641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff5f2e-1b1c-4f72-a68d-c70dcaded520 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.034162 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.035592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.036042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.036549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.037843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.039641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.054663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1133/2266] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:39.058856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.073360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d0d8-0a22-4bc4-8f76-caef90086490 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.078315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.081893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.082026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1134/2267] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:38 2022] POST /identity/v3/projects => generated 401 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:39.082125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.082125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] PATH_INFO: `/v3/projects/1a13f6f625ef4d2e9db262a4e561648b/users/6ad1e57ceaa244a0bd142f585b2cc930/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.087296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.101073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a13f6f625ef4d2e9db262a4e561648b, user_id=6ad1e57ceaa244a0bd142f585b2cc930, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.103808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.158594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1134/2268] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:39 2022] PUT /identity/v3/projects/1a13f6f625ef4d2e9db262a4e561648b/users/6ad1e57ceaa244a0bd142f585b2cc930/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:39.162901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.199737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:39.283415 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac2b6c-a23c-4523-987e-f92f62e01143 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.310705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d84d5-b00f-4304-b400-eb98d0e920dc admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.316813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.317525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.317888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.318163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.318901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.320609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.338994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1135/2269] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:39.344339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.384056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1c1d4-31a2-42ee-9504-64f296219b8e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.389325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.390023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.390976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.391089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.391942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.394737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.401702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.402836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.402995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.403379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] PATH_INFO: `/v3/projects/1a13f6f625ef4d2e9db262a4e561648b/users/6ad1e57ceaa244a0bd142f585b2cc930/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.408532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a13f6f625ef4d2e9db262a4e561648b, user_id=6ad1e57ceaa244a0bd142f585b2cc930, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.411375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.438862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1136/2270] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:39 2022] PUT /identity/v3/projects/1a13f6f625ef4d2e9db262a4e561648b/users/6ad1e57ceaa244a0bd142f585b2cc930/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:39.441180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1135/2271] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:39 2022] POST /identity/v3/users => generated 307 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:39.445215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.562531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:39.571598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f3519-6f5c-47ac-b6bb-cae80d73f6e0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.588035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.589118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.589525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.589866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.590692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.592969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.616543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.623843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1137/2272] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:39.630580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37163d4b-a83b-4cc6-89d4-c8d24bdeb609 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.649479 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.650552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.650831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.651102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] PATH_INFO: `/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d/users/2ec27437337940589a534ee9b7b4362e/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.693641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdbaecdc5e145adb6ca12db1d72976d, user_id=2ec27437337940589a534ee9b7b4362e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.702720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.741167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.741305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1136/2273] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:39 2022] PUT /identity/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d/users/2ec27437337940589a534ee9b7b4362e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:39.753369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a1e0e-af46-46fa-a1c3-523e25cecf2f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.909437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.910703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.911066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.911461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.913194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.914865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9c793-59cd-4b09-be14-18685da4ad58 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:39.947139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:39.947701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1138/2274] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:39.962390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c912d86-651d-46eb-98f8-05978ea7683e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:39.968290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:39.969254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:39.969689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:39.969974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] PATH_INFO: `/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d/users/2ec27437337940589a534ee9b7b4362e/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:39.972067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdbaecdc5e145adb6ca12db1d72976d, user_id=2ec27437337940589a534ee9b7b4362e, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:39.974991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:40.005509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1137/2275] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:39 2022] PUT /identity/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d/users/2ec27437337940589a534ee9b7b4362e/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:40.017314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1385d-604a-495c-a404-4c0464814349 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:40.017674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1385d-604a-495c-a404-4c0464814349 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:40.018017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1385d-604a-495c-a404-4c0464814349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:40.142666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-99c1385d-604a-495c-a404-4c0464814349 None None] MFA Rules not processed for user `2ec27437337940589a534ee9b7b4362e`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:40.143939 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-99c1385d-604a-495c-a404-4c0464814349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:40.437954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1139/2276] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:40.476792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:40.478824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:40.674250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b5171-50ff-4c59-a5dd-d26eefec64c3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:40.707499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:40.708375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:40.709169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:40.709169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:40.729751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:40.732299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178926e-85fa-42e1-8b59-defcbb646a17 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:40.761324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1138/2277] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:40.921497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1385d-604a-495c-a404-4c0464814349 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:40.937175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1385d-604a-495c-a404-4c0464814349 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:40.943906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:40.945313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:40.946023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:40.946627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:40.977521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:40.977799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:40.983325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:41.056520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] MFA Rules not processed for user `69c4f81285904da78e96a4a515ec2cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:41.061382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:41.099263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:41.100778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:41.106928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:41.125045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1140/2278] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:41.277335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1139/2279] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:41.286380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:41.289054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:41.342797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:41.554593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0eaf-4353-4005-98ae-d7f4bf6c4126 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:41.563675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:41.564523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:41.564958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:41.565283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:41.577054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:41.578758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d282ef-8827-4144-ad00-5895d10a9e66 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:41.591034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1141/2280] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:42.474644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:42.476364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:42.575530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d328-1dcd-41d1-bf69-eabb30d1400a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:42.581081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:42.581701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:42.582073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:42.582417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] PATH_INFO: `/v3/users/48bcb61c9e0244daaa751c76868170e5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:42.584124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48bcb61c9e0244daaa751c76868170e5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:42.586252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:42.668536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48bcb61c9e0244daaa751c76868170e5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:42.669310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48bcb61c9e0244daaa751c76868170e5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:42.693851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48bcb61c9e0244daaa751c76868170e5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:42.716062 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48bcb61c9e0244daaa751c76868170e5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:42.716817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48bcb61c9e0244daaa751c76868170e5'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:42.741972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1140/2281] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:42 2022] DELETE /identity/v3/users/48bcb61c9e0244daaa751c76868170e5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:42.743118 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:42.743564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:42.743748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:42.793976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:42.796182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:42.951082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1142/2282] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:42.976265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:42.978704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:43.129078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:43.183526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfa2f3-70eb-43ba-b5ec-8256a3735265 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:43.190649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:43.191302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:43.191574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:43.191915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:43.205383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:43.207208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:43.220139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1141/2283] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:44.856453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:44.860248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:44.901562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25200-2280-4980-a7ef-c54c66fdc5fe None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:44.925147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:44.931034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:44.931918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:44.932209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] PATH_INFO: `/v3/projects/97dd99ed2e79420887f3382fecfc85f1` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:44.939603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97dd99ed2e79420887f3382fecfc85f1)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:44.941984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:45.056860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97dd99ed2e79420887f3382fecfc85f1', 'request_id': 'req-68e81f30-3bf7-4b38-ac8a-865389eb357e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.073510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97dd99ed2e79420887f3382fecfc85f1', 'request_id': 'req-68e81f30-3bf7-4b38-ac8a-865389eb357e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.086748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97dd99ed2e79420887f3382fecfc85f1', 'request_id': 'req-68e81f30-3bf7-4b38-ac8a-865389eb357e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.114955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] The token cache is being invalidate because project 97dd99ed2e79420887f3382fecfc85f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:45.115250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.116263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.118993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1143/2284] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:44 2022] DELETE /identity/v3/projects/97dd99ed2e79420887f3382fecfc85f1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:45.122864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:45.134573 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4574e9d-21ec-4782-b88a-8df306cc4bb4 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:45.229839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:45.232950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:45.233387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:45.234674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] PATH_INFO: `/v3/users/f6462221ad9f4f1d824b3c45e9142192` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:45.239359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6462221ad9f4f1d824b3c45e9142192)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:45.261790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:45.347143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6462221ad9f4f1d824b3c45e9142192'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.349799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6462221ad9f4f1d824b3c45e9142192'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.398669 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6462221ad9f4f1d824b3c45e9142192'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.412331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6462221ad9f4f1d824b3c45e9142192'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.412993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-46a81bd0-f516-40d1-b1e2-6fceb5173249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6462221ad9f4f1d824b3c45e9142192'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:45.447134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1142/2285] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:45 2022] DELETE /identity/v3/users/f6462221ad9f4f1d824b3c45e9142192 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:45.709448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:45.711002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:45.756860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e81f30-3bf7-4b38-ac8a-865389eb357e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:45.921633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a465-60bb-41df-941e-6debfa3b8c07 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:45.922571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a465-60bb-41df-941e-6debfa3b8c07 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:45.923661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79a465-60bb-41df-941e-6debfa3b8c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:45.936265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:45.981299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ab79a465-60bb-41df-941e-6debfa3b8c07 None None] MFA Rules not processed for user `69c4f81285904da78e96a4a515ec2cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:45.984879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ab79a465-60bb-41df-941e-6debfa3b8c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:46.114122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:46.115282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.115716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.116139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] PATH_INFO: `/v3/users/28b4a840250e4973916a45761e9b6874` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:46.117897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b4a840250e4973916a45761e9b6874)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:46.120512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:46.134703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:46.158371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1143/2286] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:46.279547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b4a840250e4973916a45761e9b6874'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.280459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b4a840250e4973916a45761e9b6874'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.281336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b4a840250e4973916a45761e9b6874'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.304329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b4a840250e4973916a45761e9b6874'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.352437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b4a840250e4973916a45761e9b6874'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.390373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1144/2287] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:45 2022] DELETE /identity/v3/users/28b4a840250e4973916a45761e9b6874 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:46.395504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.395814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.396092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:46.437714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:46.445212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:46.558011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:46.559692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:46.608380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1144/2288] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:46.670746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:46.672742 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:46.751611 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c1039-c327-4ef0-82e5-f730a713294e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:46.759460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:46.760703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.761220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.761674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] PATH_INFO: `/v3/users/dc92fac8922c469684f59fbb316b76df` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:46.764368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc92fac8922c469684f59fbb316b76df)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:46.767022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:46.834513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83f358-c055-40dc-8245-8512ac11c186 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:46.854640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:46.855309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.855588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.855857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:46.877818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:46.879055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:46.880966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:46.883681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc92fac8922c469684f59fbb316b76df'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.884652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc92fac8922c469684f59fbb316b76df'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.886329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc92fac8922c469684f59fbb316b76df'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.900214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc92fac8922c469684f59fbb316b76df'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.905107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1145/2289] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:46.906101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:46.907517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:46.934541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-87864d83-4723-4de8-a74a-b548183557a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc92fac8922c469684f59fbb316b76df'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:46.936378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2811d0-5303-4638-8a1a-d76186797574 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:46.951470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:46.952410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.952691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.952987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] PATH_INFO: `/v3/projects/913da9507c1d4bf1b9c6cc9f889b406e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:46.954476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] RBAC: Authorizing `identity:delete_project(project_id=913da9507c1d4bf1b9c6cc9f889b406e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:46.956411 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:46.962173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1145/2290] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:46 2022] DELETE /identity/v3/users/dc92fac8922c469684f59fbb316b76df => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:46.970520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:46.970922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:46.971309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:47.043010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:47.045003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:47.045850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '913da9507c1d4bf1b9c6cc9f889b406e', 'request_id': 'req-f343c6f6-01f7-40ed-be1a-9412cdb0783c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.055546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '913da9507c1d4bf1b9c6cc9f889b406e', 'request_id': 'req-f343c6f6-01f7-40ed-be1a-9412cdb0783c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.062458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '913da9507c1d4bf1b9c6cc9f889b406e', 'request_id': 'req-f343c6f6-01f7-40ed-be1a-9412cdb0783c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.085035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] The token cache is being invalidate because project 913da9507c1d4bf1b9c6cc9f889b406e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:47.085684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.086636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.088940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1146/2291] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:46 2022] DELETE /identity/v3/projects/913da9507c1d4bf1b9c6cc9f889b406e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:47.092623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:47.094316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:47.150652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:47.217302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1146/2292] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:47.225180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343c6f6-01f7-40ed-be1a-9412cdb0783c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:47.230438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:47.231367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:47.231655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:47.231930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] PATH_INFO: `/v3/users/84ae170d54d043aba5857ffcba43af16` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:47.233926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ae170d54d043aba5857ffcba43af16)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:47.236143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:47.283325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:47.285530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:47.328379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ae170d54d043aba5857ffcba43af16'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.329335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ae170d54d043aba5857ffcba43af16'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.357943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ae170d54d043aba5857ffcba43af16'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.370385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ae170d54d043aba5857ffcba43af16'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.372682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ae170d54d043aba5857ffcba43af16'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:47.396502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8fa84-dbd5-49ca-9187-26463569c732 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:47.405482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1147/2293] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:47 2022] DELETE /identity/v3/users/84ae170d54d043aba5857ffcba43af16 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:47.406173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:47.407297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:47.407589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:47.407914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:47.409924 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:47.430590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:47.432303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:47.445632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1147/2294] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:48.428781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:48.434889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:48.634635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b91f8-bbbd-49d5-bf80-15101e3d536b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:48.648174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:48.649112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:48.649398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:48.649675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] PATH_INFO: `/v3/projects/92f6e708f5f74957b064a1b2ffa2a8c5` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:48.653772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f6e708f5f74957b064a1b2ffa2a8c5)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:48.655713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:48.755206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f6e708f5f74957b064a1b2ffa2a8c5', 'request_id': 'req-d917c634-3f8a-4598-8092-bf680e50e9ac'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:48.756764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:48.769938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f6e708f5f74957b064a1b2ffa2a8c5', 'request_id': 'req-d917c634-3f8a-4598-8092-bf680e50e9ac'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:48.793539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f6e708f5f74957b064a1b2ffa2a8c5', 'request_id': 'req-d917c634-3f8a-4598-8092-bf680e50e9ac'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:48.814970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] The token cache is being invalidate because project 92f6e708f5f74957b064a1b2ffa2a8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:48.815297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:48.817010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:48.822470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1148/2295] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:48 2022] DELETE /identity/v3/projects/92f6e708f5f74957b064a1b2ffa2a8c5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:48.826264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:48.838552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:48.840162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:48.847420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b799-85fa-4b06-a2ea-7384ccb995dc service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.054092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917c634-3f8a-4598-8092-bf680e50e9ac admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.060336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:49.061268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.061755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.062179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] PATH_INFO: `/v3/users/2ec27437337940589a534ee9b7b4362e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.064389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec27437337940589a534ee9b7b4362e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:49.067011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:49.071056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:49.072180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.072621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.074068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] PATH_INFO: `/v3/projects/11cc20b2e85d4c5b81f48078cad62188` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.077080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11cc20b2e85d4c5b81f48078cad62188)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:49.080316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:49.081497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:49.166262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec27437337940589a534ee9b7b4362e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.167469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec27437337940589a534ee9b7b4362e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.168682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec27437337940589a534ee9b7b4362e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.183326 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11cc20b2e85d4c5b81f48078cad62188', 'request_id': 'req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.189509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec27437337940589a534ee9b7b4362e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.209707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11cc20b2e85d4c5b81f48078cad62188', 'request_id': 'req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.219591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec27437337940589a534ee9b7b4362e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.228916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11cc20b2e85d4c5b81f48078cad62188', 'request_id': 'req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.254004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] The token cache is being invalidate because project 11cc20b2e85d4c5b81f48078cad62188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:49.254382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.258894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1148/2296] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:48 2022] DELETE /identity/v3/users/2ec27437337940589a534ee9b7b4362e => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:49.258894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:49.259175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b4b710d3-bcc4-4d2d-8b24-7f03323a7930 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.264058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:49.267653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1149/2297] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:48 2022] DELETE /identity/v3/projects/11cc20b2e85d4c5b81f48078cad62188 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:49.269344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21a864-a6c0-413d-836b-a08543364c27 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.272475 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21a864-a6c0-413d-836b-a08543364c27 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.273703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21a864-a6c0-413d-836b-a08543364c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.322772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1d21a864-a6c0-413d-836b-a08543364c27 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:49.325146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1d21a864-a6c0-413d-836b-a08543364c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:49.427717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011ea3e-5bfa-405e-b2bb-eadf49f02a47 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.445314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:49.451915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.452231 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.452532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] PATH_INFO: `/v3/projects/d6aa903fabb6468d86ab889d0409d787` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.458040 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6aa903fabb6468d86ab889d0409d787)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:49.460063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:49.494728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1150/2298] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:49.502722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.503004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.503484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.548674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:49.562850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:49.565123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:49.586366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1151/2299] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:49.590520 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:49.605639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb07e6-f383-47b2-886e-d62aee67cf2c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.608799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6aa903fabb6468d86ab889d0409d787', 'request_id': 'req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.619974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6aa903fabb6468d86ab889d0409d787', 'request_id': 'req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.629291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6aa903fabb6468d86ab889d0409d787', 'request_id': 'req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.654970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] The token cache is being invalidate because project d6aa903fabb6468d86ab889d0409d787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:49.655637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.656571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:49.673692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1149/2300] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:49 2022] DELETE /identity/v3/projects/d6aa903fabb6468d86ab889d0409d787 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:49.728407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:49.729502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.729982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.730684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.731169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:49.732373 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:49.735182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:49.754957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1152/2301] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:49.772015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:49.776409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:49.807713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782228f8-a3a7-4c87-b219-e8f2f1c8a9e8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.818517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:49.819274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:49.819557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:49.819827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:49.820534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:49.824256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:49.846493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:49.848655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:49.851973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:49.883844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655a74-887a-4f3c-b0f9-fad74938d856 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:49.890058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1150/2302] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:49 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:49.891260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.015588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.016490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.016803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.017084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] PATH_INFO: `/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.019425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdbaecdc5e145adb6ca12db1d72976d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.035877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.053987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab21e47-f420-42a1-a3c2-af6623fe709f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.059927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.065181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.065463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.065734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.066481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.068970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.111512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1151/2303] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:49 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:50.112604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.136375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714b52b-ab99-49ed-a239-3b2f2f1a61a0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.139016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdbaecdc5e145adb6ca12db1d72976d', 'request_id': 'req-c3b2dfa9-d712-4774-8001-f4d584cb84b3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:50.154641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdbaecdc5e145adb6ca12db1d72976d', 'request_id': 'req-c3b2dfa9-d712-4774-8001-f4d584cb84b3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:50.172600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdbaecdc5e145adb6ca12db1d72976d', 'request_id': 'req-c3b2dfa9-d712-4774-8001-f4d584cb84b3'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:50.200351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] The token cache is being invalidate because project 9cdbaecdc5e145adb6ca12db1d72976d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:50.200694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:50.202928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c3b2dfa9-d712-4774-8001-f4d584cb84b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:50.207982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1153/2304] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:49 2022] DELETE /identity/v3/projects/9cdbaecdc5e145adb6ca12db1d72976d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:50.211036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2191-cfe2-49e3-b0c8-f7517d1d9312 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.211336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2191-cfe2-49e3-b0c8-f7517d1d9312 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.211620 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2191-cfe2-49e3-b0c8-f7517d1d9312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.238288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c34a2191-cfe2-49e3-b0c8-f7517d1d9312 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:50.240210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c34a2191-cfe2-49e3-b0c8-f7517d1d9312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:50.264761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:50.295772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.296984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.297589 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.298078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.299641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.305826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.340025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1152/2305] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:50.341317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.348764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1154/2306] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:50.354508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.355232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:50.356635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.364957 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.400880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053c345-137d-4b78-9ebd-a1d6fabc5f83 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.409316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:50.410398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:50.413463 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.414256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.414637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.415010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.416108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.421906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.433546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1155/2307] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:50.438704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.448655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b987ad-126c-46ed-9bb8-e1f7b545dce2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.452701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1153/2308] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:50.453892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.454771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.454869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.455381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.456240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:50.456549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.457697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.458582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.473340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1156/2309] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:53:50.480068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.482374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0c57dd-5ae7-4240-96be-5cdcfcfcebab admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.493594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.498659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.498883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba2735-b1f8-4bfd-9848-c03a2f330ba3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.499334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.499334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] PATH_INFO: `/v3/projects/4f593a8cd9654b4897676233118e8eef/users/a62d6e10161e48b3a322f5a719260d91/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.504104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.505434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.505983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.506512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.507720 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.510093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.525858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f593a8cd9654b4897676233118e8eef, user_id=a62d6e10161e48b3a322f5a719260d91, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.530467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee7e70-2dfb-4bcb-8f27-96b06aa2b24e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.551680 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1154/2310] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:50 2022] PUT /identity/v3/projects/4f593a8cd9654b4897676233118e8eef/users/a62d6e10161e48b3a322f5a719260d91/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:50.570532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.571895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.572201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.579108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1157/2311] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:50 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:50.580651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.662012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] MFA Rules not processed for user `a62d6e10161e48b3a322f5a719260d91`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:50.663769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:50.705514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d11194-ea32-4176-a1d8-ef6c53426544 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.710803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.711500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.711778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.712051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.712778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.714714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.748254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1158/2312] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:50 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:50.749304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.768003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab4e2c-e60e-4144-87cc-1f5b62fab3b6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.790536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.790995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.791443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.791723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.792473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.800284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.809220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:50.824664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1159/2313] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:50.835315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.855545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c5881-093f-4f40-ab3f-2a170d06e3f4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.869124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.869877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.870161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.870436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:50.871448 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:50.875136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:50.927082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1155/2315] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:50.927634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1160/2315] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:50.930278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.941718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:50.944430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:50.976664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a798-acfa-419b-9d98-4f73fafa4113 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:50.992512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:50.993486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:50.993770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:50.994043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] PATH_INFO: `/v3/projects/25a814280743405f877b11de2118ce37/users/7cb2a83abc32485a97e17e02f3d920d1/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.062198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a814280743405f877b11de2118ce37, user_id=7cb2a83abc32485a97e17e02f3d920d1, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:51.065367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c27e61-6ede-4bba-90b2-1d1fc2fcee29 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:51.112825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1156/2316] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:50 2022] PUT /identity/v3/projects/25a814280743405f877b11de2118ce37/users/7cb2a83abc32485a97e17e02f3d920d1/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:51.121652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbf-e16e-414e-b9fb-bc835dd31dd8 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.121652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbf-e16e-414e-b9fb-bc835dd31dd8 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.121652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfcbf-e16e-414e-b9fb-bc835dd31dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.174534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b87a2-b0f7-48e9-8a67-3831d5622710 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:51.175845 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a6edfcbf-e16e-414e-b9fb-bc835dd31dd8 None None] MFA Rules not processed for user `6ad1e57ceaa244a0bd142f585b2cc930`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:51.185858 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:51.186897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a6edfcbf-e16e-414e-b9fb-bc835dd31dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:51.283744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:51.284705 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.285027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.286295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.310847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1157/2317] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:51.313521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.313846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.314196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.355959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] MFA Rules not processed for user `7cb2a83abc32485a97e17e02f3d920d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:51.357753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:51.432648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:51.435821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:51.452471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1161/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:51.453668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:51.454933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:51.520429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1158/2319] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:51.521396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:51.555073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9c879-4273-43e9-a98a-78e601f7d317 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:51.567050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:51.567760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.568039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.568307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.571086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:51.601205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:51.699219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ede06-71a1-4c04-b993-5d1e5f1048bf None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:51.711454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:51.712673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.713050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.713369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.714157 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:51.716041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:51.755036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:51.758867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:51.778520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1159/2320] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:51 2022] POST /identity/v3/projects => generated 381 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:51.780305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:51.801355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1162/2321] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:51.946842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04ef2f-9000-4231-abf7-c2f584a0a643 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:51.955709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:51.956408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:51.956686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:51.956988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:51.958494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:51.959969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a80caa-5f37-4b64-a250-b04a0236905d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.029520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1160/2322] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:51 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:52.033955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.059881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfba2-6862-4160-93b7-92cdcaaf964b service glance] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.070257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.070257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.070257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.072629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.073913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.074252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.074636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.075568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.079750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.106239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1163/2323] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:52.109255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.126223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:52.133153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20813e71-a216-4b2e-a841-9d39c605884d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.150685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:52.152248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:52.162341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.163363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.163653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.163930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] PATH_INFO: `/v3/projects/9cdc5f1450164ded8cf7a9750fadf259/users/9299232bb74c4e7fb32c18269953d15b/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.207654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdc5f1450164ded8cf7a9750fadf259, user_id=9299232bb74c4e7fb32c18269953d15b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.210811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.237984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1164/2324] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:52 2022] PUT /identity/v3/projects/9cdc5f1450164ded8cf7a9750fadf259/users/9299232bb74c4e7fb32c18269953d15b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:52.239733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.278856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1161/2325] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:52.347124 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.348837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:52.400320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ea944-727b-459b-9a48-f64ac168d314 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.437638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.438652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.438934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.439207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.439966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.443781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.457599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:52.481608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1165/2326] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:53:52.486782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.492567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc0d81-fd6c-45b6-9235-9074087eadc0 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.508090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb2bb4f-f1b3-4664-bd41-96e51c154788 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.522682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.523887 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.524483 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.524973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] PATH_INFO: `/v3/projects/9cdc5f1450164ded8cf7a9750fadf259/users/9299232bb74c4e7fb32c18269953d15b/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.527212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cdc5f1450164ded8cf7a9750fadf259, user_id=9299232bb74c4e7fb32c18269953d15b, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.530132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a501-6966-43b3-a137-17f13f2b5f9d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.543367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1166/2327] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:52 2022] PUT /identity/v3/projects/9cdc5f1450164ded8cf7a9750fadf259/users/9299232bb74c4e7fb32c18269953d15b/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:52.556689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.558490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.559055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.594938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] MFA Rules not processed for user `9299232bb74c4e7fb32c18269953d15b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:52.596514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:52.615110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.618606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.620329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.621395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.713436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.715288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.754426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1167/2328] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:52.757989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1162/2329] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:53:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 14:53:52.763650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:52.849672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:52.857971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1888f1-6c88-445b-a52b-fc36276fdbad None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:52.869424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:52.870595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:52.871197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:52.871865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:52.895782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:52.898387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:52.921336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1168/2330] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:53.097679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:53.212474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570322c-5cef-4f30-9420-c07de5982edc service swift] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:53.217789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:53.218472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:53.218805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:53.219080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:53.384631 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:53.446318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:53.449113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352926-d5b6-4f72-a38c-563cae16120b service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:53.479405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1163/2331] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:54.124283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:54.264886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385c03-d590-4550-a866-94114126ad87 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:54.290425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:54.293130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:54.293414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:54.293696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] PATH_INFO: `/v3/users/7cb2a83abc32485a97e17e02f3d920d1` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:54.300655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb2a83abc32485a97e17e02f3d920d1)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:54.303401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:54.456050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb2a83abc32485a97e17e02f3d920d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:54.456951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb2a83abc32485a97e17e02f3d920d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:54.498848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb2a83abc32485a97e17e02f3d920d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:54.520449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb2a83abc32485a97e17e02f3d920d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:54.521359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb2a83abc32485a97e17e02f3d920d1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:54.556999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1169/2332] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:54 2022] DELETE /identity/v3/users/7cb2a83abc32485a97e17e02f3d920d1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:54.561742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:54.562269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:54.562269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:54.601894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:54.603404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:54.791038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:54.804059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:54.851284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1164/2333] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:54.868549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:54.870323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:54.930259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141c233-9354-427d-959a-e8ed874ed3b3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:54.937956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:54.939422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:54.939917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:54.940365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] PATH_INFO: `/v3/users/a62d6e10161e48b3a322f5a719260d91` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:54.941976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62d6e10161e48b3a322f5a719260d91)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:54.944422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:54.960735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:55.009910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806ab97-6a24-4d34-a731-8ab69eeab754 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:55.033267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:55.033958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:55.034241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:55.037837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:55.056465 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62d6e10161e48b3a322f5a719260d91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:55.058250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62d6e10161e48b3a322f5a719260d91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:55.068799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:55.070731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547bed78-1933-446d-84f7-1b9116d8a717 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:55.085417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62d6e10161e48b3a322f5a719260d91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:55.099425 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62d6e10161e48b3a322f5a719260d91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:55.100403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62d6e10161e48b3a322f5a719260d91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:55.103110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1165/2334] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:55.134497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1170/2335] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:54 2022] DELETE /identity/v3/users/a62d6e10161e48b3a322f5a719260d91 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:55.136258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:55.136613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:55.137025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:55.174242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:55.177603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:55.340772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1166/2336] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:55.433192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:55.434774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:55.557997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38408f84-487a-47e0-ab7f-f7862a0bc21e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:55.574628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:55.575596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:55.575974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:55.576342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:55.610142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:55.611647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:55.662616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1171/2337] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:53:55.936171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:55.938781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:55.953650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0859d-bc4e-471b-b8e5-55ab8494c43a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:55.960684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:55.961712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:55.962156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:55.962531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] PATH_INFO: `/v3/projects/25a814280743405f877b11de2118ce37` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:55.964656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a814280743405f877b11de2118ce37)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:55.967329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:56.019065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:56.087973 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a814280743405f877b11de2118ce37', 'request_id': 'req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.096344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a814280743405f877b11de2118ce37', 'request_id': 'req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.109710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a814280743405f877b11de2118ce37', 'request_id': 'req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.138158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] The token cache is being invalidate because project 25a814280743405f877b11de2118ce37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:56.139221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.140105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.142558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1167/2338] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:55 2022] DELETE /identity/v3/projects/25a814280743405f877b11de2118ce37 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:56.146697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:56.164586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d714a92-2739-40d4-ad81-f95768fa497f service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:56.243176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:56.245401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:56.281718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:56.283055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.283461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.283725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] PATH_INFO: `/v3/users/9299232bb74c4e7fb32c18269953d15b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.285119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9299232bb74c4e7fb32c18269953d15b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:56.289298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:56.387793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:56.389287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150aeb5-f79c-4ba4-bdc9-8e767133f5c3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:56.396065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:56.397210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.397745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.398058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] PATH_INFO: `/v3/projects/4f593a8cd9654b4897676233118e8eef` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.399278 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f593a8cd9654b4897676233118e8eef)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:56.402201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:56.405293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9299232bb74c4e7fb32c18269953d15b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.406035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9299232bb74c4e7fb32c18269953d15b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.421107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9299232bb74c4e7fb32c18269953d15b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.446879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9299232bb74c4e7fb32c18269953d15b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.456847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d034bbad-34f3-40dd-b63c-c981b5ed968f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9299232bb74c4e7fb32c18269953d15b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.503619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1172/2339] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:56 2022] DELETE /identity/v3/users/9299232bb74c4e7fb32c18269953d15b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:56.520105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f593a8cd9654b4897676233118e8eef', 'request_id': 'req-142bed42-3682-40af-922f-6d6496a07713'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.528625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f593a8cd9654b4897676233118e8eef', 'request_id': 'req-142bed42-3682-40af-922f-6d6496a07713'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.538085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f593a8cd9654b4897676233118e8eef', 'request_id': 'req-142bed42-3682-40af-922f-6d6496a07713'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.556590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] The token cache is being invalidate because project 4f593a8cd9654b4897676233118e8eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:56.556993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.557696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-142bed42-3682-40af-922f-6d6496a07713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:56.566055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1168/2340] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:56 2022] DELETE /identity/v3/projects/4f593a8cd9654b4897676233118e8eef => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:56.567557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.567988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.568297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.590210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:56.592057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:56.752260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1173/2341] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:56.760054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.760276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.760537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.811232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:56.820781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:56.860762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1169/2342] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:56.864500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:56.883443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83f0d-2c98-4d2c-aabc-c836ea396699 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:56.889659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:56.890347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.890629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.891701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.892452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:56.893124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:56.894753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:56.921488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1174/2343] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:56.921704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:56.938641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1e85a-bf83-4c26-b637-13e1c1a8ad5f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:56.961998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:56.962720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:56.962984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:56.963233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:56.963947 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:56.966372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.035646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1170/2344] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:53:57.036968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.055399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619af1-f751-4c64-9bc0-f4e44ff6b41b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.151660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.152403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.152497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.153536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.153536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.155476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.187274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1175/2345] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:57 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:57.191555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.217682 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03756f80-df88-41a2-b43d-ca2cc4e42d31 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.228965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.229797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.230096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.230438 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.239722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.239722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.241551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:57.258490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.266838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1171/2346] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:57.286695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7162-2f0c-4e93-8d46-309b72226bc8 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.293337 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.294111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.294402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.294681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.296491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.298166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.305215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.307304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.321112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1176/2347] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:57.323051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.329264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af5d13-f4a9-435e-a4b6-04b91ff9c315 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.345696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.347004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.347479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.347943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] PATH_INFO: `/v3/projects/9cdc5f1450164ded8cf7a9750fadf259` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.350581 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cdc5f1450164ded8cf7a9750fadf259)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.352836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.354368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca668-c21e-4ba7-a2ec-e85259d42b09 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.361223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.370308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.370607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.371010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] PATH_INFO: `/v3/projects/b1afac63bc184f7d8d32d86ddaa7a55e/users/78602b3f9f05449383be483afd8aeeb1/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.401284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1afac63bc184f7d8d32d86ddaa7a55e, user_id=78602b3f9f05449383be483afd8aeeb1, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.404966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a26aa-2353-4772-bfe3-34d1855d5a14 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.409400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:57.443777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1177/2348] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:57 2022] PUT /identity/v3/projects/b1afac63bc184f7d8d32d86ddaa7a55e/users/78602b3f9f05449383be483afd8aeeb1/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:57.457147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cdc5f1450164ded8cf7a9750fadf259', 'request_id': 'req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:57.457864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.458608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.458608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.469722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cdc5f1450164ded8cf7a9750fadf259', 'request_id': 'req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:57.487470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cdc5f1450164ded8cf7a9750fadf259', 'request_id': 'req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:57.498140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] MFA Rules not processed for user `78602b3f9f05449383be483afd8aeeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:57.500894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.505528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] The token cache is being invalidate because project 9cdc5f1450164ded8cf7a9750fadf259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:53:57.505899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:57.510316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e7a32d1a-abf8-4fb8-86e1-c500d440e9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:57.512477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1172/2349] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:53:57 2022] DELETE /identity/v3/projects/9cdc5f1450164ded8cf7a9750fadf259 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:57.517916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239dbd-f4f3-4702-b55a-267e5f68b7fe None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.518323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239dbd-f4f3-4702-b55a-267e5f68b7fe None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.518694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3239dbd-f4f3-4702-b55a-267e5f68b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.554047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b3239dbd-f4f3-4702-b55a-267e5f68b7fe None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:57.555407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b3239dbd-f4f3-4702-b55a-267e5f68b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.641798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1178/2350] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:57.653556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.655032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.759321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1173/2351] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:57.761820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.761966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.762222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.800745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bddf57-9158-449a-bd32-1bb99567ec0f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.816993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:57.818639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.819537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.819826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.820106 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.821835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.846441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1174/2352] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:57.847967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.852822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.854740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.867178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c994491-a0ba-4a07-8de4-473fe10ea947 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.879701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1179/2353] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:57.896774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:57.900232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:57.900553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:57.900891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:57.901673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:53:57.901988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:57.903656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:57.947350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.949405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:57.962550 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1175/2354] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:53:57.964169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:57.985878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bab0d-faac-4ecb-88cd-0f725a8c95d9 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:57.992486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe706ba-86d9-4fd2-9e11-206b8de710a7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.017047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.020759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.022091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.024759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] PATH_INFO: `/v3/users/78602b3f9f05449383be483afd8aeeb1` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.030720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.032866 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] RBAC: Authorizing `identity:delete_user(user_id=78602b3f9f05449383be483afd8aeeb1)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.036230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.037309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.042814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.043207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.044046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.046048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.107660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1176/2355] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:53:57 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:58.108834 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.135382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78602b3f9f05449383be483afd8aeeb1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:58.139732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78602b3f9f05449383be483afd8aeeb1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:58.162856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:58.165101 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78602b3f9f05449383be483afd8aeeb1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:58.179816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78602b3f9f05449383be483afd8aeeb1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:58.180693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3b2002d6-a5e3-4a05-85ca-f2da68d741af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78602b3f9f05449383be483afd8aeeb1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:53:58.197362 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:58.206120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f717c8-6bde-4e1e-bad7-a329a9e7ed78 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.208693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1180/2356] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:53:57 2022] DELETE /identity/v3/users/78602b3f9f05449383be483afd8aeeb1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:53:58.213819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.214116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.214993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.247569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:58.250769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:58.315079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.315775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.316056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.316342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.317989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.320876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.350616 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1177/2357] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:53:58 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:53:58.354846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.358410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:58.380681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1181/2358] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:53:58.389276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28add1f-b418-499d-8979-a62748c179c6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.391776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.393251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:58.396993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.397940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.398420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.398860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.399749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.401603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.412814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1178/2359] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:58.417498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.434078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b408d2-9e85-43ed-99d3-dfd8ad3e00a2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.439636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.440386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.440765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.441117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.441957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.443833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.462363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1179/2360] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:53:58.466981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.478322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95de0e-70be-4c75-b305-09687f8493f9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.485184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.485184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.485184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.486241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] PATH_INFO: `/v3/projects/826cff393aca4e8caa0de1e1246ba2bb/users/5ae5292faa3a46fda6ba3852ec7e95dc/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.504842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826cff393aca4e8caa0de1e1246ba2bb, user_id=5ae5292faa3a46fda6ba3852ec7e95dc, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.508321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4574364-6e23-4a91-b465-1cea365bbf61 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.535704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1180/2361] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:53:58 2022] PUT /identity/v3/projects/826cff393aca4e8caa0de1e1246ba2bb/users/5ae5292faa3a46fda6ba3852ec7e95dc/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:53:58.547370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.547995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.548373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.582029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] MFA Rules not processed for user `5ae5292faa3a46fda6ba3852ec7e95dc`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:53:58.582029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:58.600494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36e418-81b2-4c54-931a-66a038453830 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.662492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1181/2362] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:53:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:53:58.670392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.671145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.672013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.672013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.675928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:53:58.678318 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:53:58.822592 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:53:58.933242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.934899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.949015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f062bb-9ed1-401e-9633-e65611ce2088 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:53:58.956983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1182/2363] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:53:58.957647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:53:58.958555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:53:58.958832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:53:58.959106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:53:58.969076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:53:58.971176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7d2dc-e33e-4772-930b-7427042f8875 service glance] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:53:58.989753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1182/2364] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:53:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:00.454650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:00.456890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:00.469226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:00.492482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf048b12-6b15-44f8-a460-a3cb4d74fc03 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:00.510407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:00.512026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:00.512619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:00.513107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] PATH_INFO: `/v3/projects/b1afac63bc184f7d8d32d86ddaa7a55e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:00.515923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1afac63bc184f7d8d32d86ddaa7a55e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:00.522147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:00.666481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1afac63bc184f7d8d32d86ddaa7a55e', 'request_id': 'req-f800c7ed-e964-446c-a335-a46956cab28a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:00.692588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1afac63bc184f7d8d32d86ddaa7a55e', 'request_id': 'req-f800c7ed-e964-446c-a335-a46956cab28a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:00.714524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1afac63bc184f7d8d32d86ddaa7a55e', 'request_id': 'req-f800c7ed-e964-446c-a335-a46956cab28a'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:00.752618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] The token cache is being invalidate because project b1afac63bc184f7d8d32d86ddaa7a55e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:00.752982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:00.753638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f800c7ed-e964-446c-a335-a46956cab28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:00.755599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1183/2365] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:00 2022] DELETE /identity/v3/projects/b1afac63bc184f7d8d32d86ddaa7a55e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:00.760882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:00.761444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:00.761444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:00.819570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:00.822084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:01.073072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1183/2366] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:01.081685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.082056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.082399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.105853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:01.111359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:01.132137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.146860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1184/2367] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:01.156269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020d831-6c8e-406e-9fea-96189ebf2b8b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.161449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.162131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.162619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.162898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.164403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:54:01.164738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.167848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.195340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.199407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1184/2368] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:54:01.204467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9458-ddeb-41d2-9862-095ca3ab854b None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.210294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.210966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.211319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.211503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.212609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.215076 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.257289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1185/2369] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:54:01 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:54:01.261471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.273275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614501e-ca0c-46e2-b485-d8ee95315297 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.345082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.346655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.347010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.347376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.348189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.350742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.384833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1185/2370] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:54:01 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:54:01.388819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.412822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0521a-2b8f-41e5-9888-b29a44944787 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.419042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.419812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.420164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.420670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.423247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.425069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.445753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1186/2371] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:54:01.449970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.475490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6d80-ad7d-40ec-bba4-56bfc89c5b6f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.482587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.484163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.484556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.484934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.485752 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.487566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70334ef-3959-478f-9178-2b69c33128ab admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.507666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1186/2372] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:54:01.515040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.530964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98969-94d6-420f-9b4a-769c2898223f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.544478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.546083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.546803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.547293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] PATH_INFO: `/v3/projects/108918ca0a5841d799c4fd297c5648c5/users/ada56e3d2ba346c8a8b7562b9ab8b6ab/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.619954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=108918ca0a5841d799c4fd297c5648c5, user_id=ada56e3d2ba346c8a8b7562b9ab8b6ab, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.622932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.661637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1187/2373] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:54:01 2022] PUT /identity/v3/projects/108918ca0a5841d799c4fd297c5648c5/users/ada56e3d2ba346c8a8b7562b9ab8b6ab/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:01.663762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0391e-d430-43d8-91f3-52d14038e059 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.663762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0391e-d430-43d8-91f3-52d14038e059 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.663762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0391e-d430-43d8-91f3-52d14038e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.700695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3ee0391e-d430-43d8-91f3-52d14038e059 None None] MFA Rules not processed for user `ada56e3d2ba346c8a8b7562b9ab8b6ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:01.702216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3ee0391e-d430-43d8-91f3-52d14038e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:01.725306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:01.800826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1187/2374] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:01.811502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:01.813571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:01.885323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f94e-35df-40f2-8f2d-2085f5240992 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:01.889917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:01.890763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:01.891077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:01.891464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:01.909454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:01.909692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc5eae-2b6a-4c0c-b72b-38498e5d92b8 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:01.920494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1188/2375] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:09.261144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ad7-74b5-4964-b145-ad809d74bae4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:09.262410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ad7-74b5-4964-b145-ad809d74bae4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:09.270102 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00ad7-74b5-4964-b145-ad809d74bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:09.294583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d5a00ad7-74b5-4964-b145-ad809d74bae4 None None] MFA Rules not processed for user `ad9a7c6755784828b967f1bef37f6441`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:09.295827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d5a00ad7-74b5-4964-b145-ad809d74bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:09.429920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1188/2376] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:11.359600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fcc0-e180-4370-821c-2f9c016b691d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:11.360126 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fcc0-e180-4370-821c-2f9c016b691d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:11.360244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1fcc0-e180-4370-821c-2f9c016b691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:11.379868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-45a1fcc0-e180-4370-821c-2f9c016b691d None None] MFA Rules not processed for user `87c3f39c0bed4fadbc8a556c857baf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:11.381364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-45a1fcc0-e180-4370-821c-2f9c016b691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:11.408386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:11.459095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1189/2377] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:12.480220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:12.480613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:12.480853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:12.503299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] MFA Rules not processed for user `afc8379be09748a68ade6af9b99cdfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:12.504625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:12.586927 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1189/2378] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:13.335707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273d51-aef3-459b-9b54-05515519aede None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:13.336253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273d51-aef3-459b-9b54-05515519aede None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:13.336253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05273d51-aef3-459b-9b54-05515519aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:13.357784 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-05273d51-aef3-459b-9b54-05515519aede None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:13.359645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-05273d51-aef3-459b-9b54-05515519aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:13.459043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1190/2379] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:54:13.474213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:13.476232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:13.579179 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b6ee27-6d75-417a-9d3c-553617993432 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:13.591403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:13.593049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:13.593582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:13.594913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:13.608448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:13.610349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:13.615052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:13.645707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1190/2380] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:54:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:54:13.856003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:13.856559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:13.857151 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:13.896499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:13.900969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:13.922840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1191/2381] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:54:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:13.944232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:13.976365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e5a7c-9f40-441a-a3b0-6e7210a79925 service swift] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:14.000439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:14.004234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:14.013384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:14.013667 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:14.064907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:14.070120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b96847-c420-434f-b8a7-0797418db147 service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:14.093990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1191/2382] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:54:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:54:16.139340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:16.286077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd76f-461e-4f33-9744-6cf33777cfea None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:16.291460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:16.292376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:16.292656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:16.292962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] PATH_INFO: `/v3/users/ada56e3d2ba346c8a8b7562b9ab8b6ab` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:16.294224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada56e3d2ba346c8a8b7562b9ab8b6ab)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:16.296302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:16.369308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada56e3d2ba346c8a8b7562b9ab8b6ab'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:16.369981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada56e3d2ba346c8a8b7562b9ab8b6ab'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:16.404750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada56e3d2ba346c8a8b7562b9ab8b6ab'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:16.423030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada56e3d2ba346c8a8b7562b9ab8b6ab'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:16.425506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada56e3d2ba346c8a8b7562b9ab8b6ab'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:16.429235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:16.486002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1192/2383] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:54:16 2022] DELETE /identity/v3/users/ada56e3d2ba346c8a8b7562b9ab8b6ab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:16.491382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:16.492552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:16.493051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:16.550050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:16.554861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:16.843123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1192/2384] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:16.938280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:16.939769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:17.173034 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3a80c-a4f6-4ed6-8578-b1ddfe0c2e09 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:17.178156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:17.179089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:17.179552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:17.180015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:17.192431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:17.194722 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:17.208110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1193/2385] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:19.251212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:19.252743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:19.282684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bee858-aa6b-4c19-8593-73d6b3383440 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:19.308962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:19.310109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:19.310515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:19.311097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] PATH_INFO: `/v3/projects/108918ca0a5841d799c4fd297c5648c5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:19.313952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=108918ca0a5841d799c4fd297c5648c5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:19.331660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:19.497557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '108918ca0a5841d799c4fd297c5648c5', 'request_id': 'req-f6590f3f-c442-466e-b137-3cabe040e9d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:19.505069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '108918ca0a5841d799c4fd297c5648c5', 'request_id': 'req-f6590f3f-c442-466e-b137-3cabe040e9d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:19.518397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '108918ca0a5841d799c4fd297c5648c5', 'request_id': 'req-f6590f3f-c442-466e-b137-3cabe040e9d1'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:19.545302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] The token cache is being invalidate because project 108918ca0a5841d799c4fd297c5648c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:19.545588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:19.546522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6590f3f-c442-466e-b137-3cabe040e9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:19.560801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1193/2386] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:19 2022] DELETE /identity/v3/projects/108918ca0a5841d799c4fd297c5648c5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:27.202263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=31 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:29.541416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:31.515443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:31.517685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:31.533779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6aa3db-7e00-49b8-b1c4-36ca92c122b2 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:31.626246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:31.627303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:31.627585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:31.627860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] PATH_INFO: `/v3/users/5ae5292faa3a46fda6ba3852ec7e95dc` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:31.629331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae5292faa3a46fda6ba3852ec7e95dc)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:31.631834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:31.696834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae5292faa3a46fda6ba3852ec7e95dc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:31.699904 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae5292faa3a46fda6ba3852ec7e95dc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:31.715148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae5292faa3a46fda6ba3852ec7e95dc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:31.726819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae5292faa3a46fda6ba3852ec7e95dc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:31.727512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae5292faa3a46fda6ba3852ec7e95dc'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:31.743254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1194/2387] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:54:31 2022] DELETE /identity/v3/users/5ae5292faa3a46fda6ba3852ec7e95dc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:31.747964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:31.748573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:31.748573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:31.767594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:31.768884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:31.851775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1194/2388] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:31.867219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:31.868903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:31.952769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e9ebd-3a0a-4b66-b0df-eee02cacac85 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:31.958351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:31.959301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:31.959837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:31.960224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:31.974031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:31.975964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ec126-eab5-4a69-b096-26770a2f3139 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:31.989881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1195/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:32.426809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.428425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:32.443760 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51438be-f454-4a5d-9af2-5478769e6785 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.448779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.449659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.449941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.450219 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] PATH_INFO: `/v3/projects/826cff393aca4e8caa0de1e1246ba2bb` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.451605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826cff393aca4e8caa0de1e1246ba2bb)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.454130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.506966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826cff393aca4e8caa0de1e1246ba2bb', 'request_id': 'req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:32.513901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826cff393aca4e8caa0de1e1246ba2bb', 'request_id': 'req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:32.520749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826cff393aca4e8caa0de1e1246ba2bb', 'request_id': 'req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:32.536147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] The token cache is being invalidate because project 826cff393aca4e8caa0de1e1246ba2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:32.536437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:32.537063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f05b4c90-b3b2-4967-b673-7b87b5dff2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:32.538605 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1195/2390] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:32 2022] DELETE /identity/v3/projects/826cff393aca4e8caa0de1e1246ba2bb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:32.543678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.544201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.544201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.563359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:32.564604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:32.582894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:32.630609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1196/2391] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:54:32.638534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.638894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.639177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.657728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:32.658937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:32.667624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1196/2392] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:32.672069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.683846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2bf41-4251-48a8-aabf-00b2ac8c6c51 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.690605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.691880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.692176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.692454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.693226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:54:32.693540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.695197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.707733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1197/2393] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:54:32.712153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.721937 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc3323-200c-4a02-a71e-c6599f99014e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.731368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.732103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.732345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.732650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.734117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.735326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.764263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1197/2394] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:54:32 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:54:32.768603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.779456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1f0d0-f264-40f2-9940-2d03e4cb19f4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.841283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.841991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.842262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.842536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.843232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.845244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.867953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1198/2395] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:54:32 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:54:32.872283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.883338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f3f6b-fef3-4605-b32a-15408b757137 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.888048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.888767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.889055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.889329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.890104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.891768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.903115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1198/2396] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:54:32.907754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.925045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0600f-2fa3-4761-baae-a0be9dc780c5 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.931078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.931777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.932045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.932315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.933264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.934877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f3928-623f-4637-9501-96694776c2a2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:32.945914 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1199/2397] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:54:32.950270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:32.960457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d4a93-0266-4c1d-af68-14d4c32dfe49 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:32.965345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:32.966158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:32.966432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:32.966666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] PATH_INFO: `/v3/projects/8ace62f696af4c7abde8da4335d2ae8d/users/7ef46326962f442ebac1253b0947b154/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:32.982321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ace62f696af4c7abde8da4335d2ae8d, user_id=7ef46326962f442ebac1253b0947b154, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:32.986887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:33.007685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1199/2398] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:54:32 2022] PUT /identity/v3/projects/8ace62f696af4c7abde8da4335d2ae8d/users/7ef46326962f442ebac1253b0947b154/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:54:33.021650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8d00-636d-4798-b2c9-16abbc47f06a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:33.021944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8d00-636d-4798-b2c9-16abbc47f06a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:33.022189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac8d00-636d-4798-b2c9-16abbc47f06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:33.049967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f3ac8d00-636d-4798-b2c9-16abbc47f06a None None] MFA Rules not processed for user `7ef46326962f442ebac1253b0947b154`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:33.051296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f3ac8d00-636d-4798-b2c9-16abbc47f06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:33.117374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1200/2399] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:33.131306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:33.133271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:33.157613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:33.195678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f625ce5-d8d6-421b-8b85-170c31f855ed admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:33.199726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:33.200397 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:33.200673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:33.200966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:33.210599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:33.212042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:33.221489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1200/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:33.715732 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c677-a340-406f-ac46-31e564db9143 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:33.716287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c677-a340-406f-ac46-31e564db9143 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:33.716385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1131c677-a340-406f-ac46-31e564db9143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:33.735769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1131c677-a340-406f-ac46-31e564db9143 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:33.737227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1131c677-a340-406f-ac46-31e564db9143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:33.750358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:33.796650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1201/2401] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:54:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:33.809898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:33.811735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:33.887331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876776f-c09c-4a93-b9b4-218018787edd service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:33.892700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:33.893374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:33.893669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:33.893913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:33.902610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:33.904199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:33.912560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1201/2402] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:54:35.987009 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c677-a340-406f-ac46-31e564db9143 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:35.988525 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1131c677-a340-406f-ac46-31e564db9143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:36.057464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1131c677-a340-406f-ac46-31e564db9143 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.062435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.063636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.063915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.064223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] PATH_INFO: `/v3/users/a4a159cc0128485482851c885de78e5d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.065561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a159cc0128485482851c885de78e5d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.067650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.119833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a159cc0128485482851c885de78e5d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.120584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a159cc0128485482851c885de78e5d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.133315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a159cc0128485482851c885de78e5d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.143931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a159cc0128485482851c885de78e5d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.144780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-3115e374-a782-453b-bb12-5bffbb427644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a159cc0128485482851c885de78e5d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.158280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1202/2403] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:54:35 2022] DELETE /identity/v3/users/a4a159cc0128485482851c885de78e5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:36.342287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.355473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f5d0-fb4d-4d48-aa16-ba66a7dc985e service swift] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.428500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.429483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.429771 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.430045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] PATH_INFO: `/v3/projects/c461f88b7a00462c99532ec1262cb23c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.431374 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c461f88b7a00462c99532ec1262cb23c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.433371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.482967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c461f88b7a00462c99532ec1262cb23c', 'request_id': 'req-68effb9d-fe28-4779-ba5f-64d43de8b3c7'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.489689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c461f88b7a00462c99532ec1262cb23c', 'request_id': 'req-68effb9d-fe28-4779-ba5f-64d43de8b3c7'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.490943 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:36.496263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c461f88b7a00462c99532ec1262cb23c', 'request_id': 'req-68effb9d-fe28-4779-ba5f-64d43de8b3c7'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.511289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] The token cache is being invalidate because project c461f88b7a00462c99532ec1262cb23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:36.511579 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.512195 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-68effb9d-fe28-4779-ba5f-64d43de8b3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:36.513885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1202/2404] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:36 2022] DELETE /identity/v3/projects/c461f88b7a00462c99532ec1262cb23c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:36.519187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7297970-54e8-4c22-9531-3638368d606a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.519487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7297970-54e8-4c22-9531-3638368d606a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.519760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7297970-54e8-4c22-9531-3638368d606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.539113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a7297970-54e8-4c22-9531-3638368d606a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:36.540377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a7297970-54e8-4c22-9531-3638368d606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:36.582441 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:36.606145 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1203/2405] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:54:36.617084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.617368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.617768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.638221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:36.639457 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:36.649645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1203/2406] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:36.653993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7297970-54e8-4c22-9531-3638368d606a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.665662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7297970-54e8-4c22-9531-3638368d606a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.670685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.671346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.671625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.671899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.672635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:54:36.672976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.674886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.688087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1204/2407] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:54:36.692656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.702142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a57a5-1335-498a-8175-6fbf0d8de9ce None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.707080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.707794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.708081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.708360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.709216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.711177 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.741350 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1204/2408] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:54:36 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:54:36.745349 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.756144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05781a1e-aa97-4104-9393-5b92beffacc6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.820822 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.821521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.821807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.822085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.822795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.824960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.846254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1205/2409] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:54:36 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:54:36.850407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.861007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9aa83-5cd9-490a-8ada-a9cd0aaf5fc9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.865869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.866537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.866820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.867090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.867823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.869498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.880548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1205/2410] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:54:36.884417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.896360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1fb1-2649-4006-9403-a53d4e35fb95 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.913377 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.914096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.914460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.914637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.915352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.917089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfde81dd-1f05-4e71-a713-171fb88392b3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:36.928755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1206/2411] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:54:36.932409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:36.945059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa698e37-4430-42eb-83be-d54ccf586bfd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:36.951787 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:36.952970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:36.953468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:36.953872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] PATH_INFO: `/v3/projects/b7e8ca337c9644a98ff62fa62b16126e/users/dc5b1a84796f45c286f387ab548e19f6/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:36.983282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e8ca337c9644a98ff62fa62b16126e, user_id=dc5b1a84796f45c286f387ab548e19f6, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:36.986773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:37.009103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1206/2412] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:54:36 2022] PUT /identity/v3/projects/b7e8ca337c9644a98ff62fa62b16126e/users/dc5b1a84796f45c286f387ab548e19f6/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:37.025058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:37.025636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:37.025636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:37.054810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] MFA Rules not processed for user `dc5b1a84796f45c286f387ab548e19f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:37.056072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:37.133668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1207/2413] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:37.144874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:37.146836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:37.204182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be52157-1112-4dc3-8399-763ae73553b8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:37.208591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:37.209273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:37.209601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:37.209801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:37.218895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:37.220496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a24335-610e-4473-b8d5-e568c8057203 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:37.229710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1207/2414] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:42.418125 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:42.419664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:42.464569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:42.564977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419bc2c-0bad-4e27-8537-909e3178b83d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:42.570837 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:42.571725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:42.572005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:42.572282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] PATH_INFO: `/v3/users/7ef46326962f442ebac1253b0947b154` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:42.573567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef46326962f442ebac1253b0947b154)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:42.575510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:42.623184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef46326962f442ebac1253b0947b154'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:42.623833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef46326962f442ebac1253b0947b154'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:42.636210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef46326962f442ebac1253b0947b154'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:42.645428 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef46326962f442ebac1253b0947b154'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:42.646502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef46326962f442ebac1253b0947b154'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:42.658996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1208/2415] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:54:42 2022] DELETE /identity/v3/users/7ef46326962f442ebac1253b0947b154 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:54:42.663724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:42.664218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:42.664314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:42.691640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:42.692930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:42.752539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1208/2416] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:42.762418 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:42.763966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:42.830067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:42.869532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b781c3-0d4e-46ee-87f4-e31952c621ab admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:42.873607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:42.874263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:42.874541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:42.874812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:42.885478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:42.886912 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:42.897494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1209/2417] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:43.177626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:43.179222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:43.194712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361632d2-6623-4d50-a118-bb00c05dcad7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:43.207969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:43.209125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:43.209286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:43.209499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] PATH_INFO: `/v3/projects/8ace62f696af4c7abde8da4335d2ae8d` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:43.210962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ace62f696af4c7abde8da4335d2ae8d)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:43.213144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:43.224610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:43.262545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ace62f696af4c7abde8da4335d2ae8d', 'request_id': 'req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:43.268614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ace62f696af4c7abde8da4335d2ae8d', 'request_id': 'req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:43.274430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ace62f696af4c7abde8da4335d2ae8d', 'request_id': 'req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:43.289322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] The token cache is being invalidate because project 8ace62f696af4c7abde8da4335d2ae8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:43.289609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:43.290212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-2b2dc293-b3ec-49cc-b20f-b4a0252fa9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:43.291901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1209/2418] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:43 2022] DELETE /identity/v3/projects/8ace62f696af4c7abde8da4335d2ae8d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:52.892559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=17 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:53.286139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=20,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:54:55.779834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:55.781466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:55.795783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef48a13-e14e-4207-b9e3-cc6e12b0273e service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:55.859781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:55.860853 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:55.861133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:55.861408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] PATH_INFO: `/v3/users/dc5b1a84796f45c286f387ab548e19f6` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:55.862763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5b1a84796f45c286f387ab548e19f6)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:55.865764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:55.924783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5b1a84796f45c286f387ab548e19f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:55.925474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5b1a84796f45c286f387ab548e19f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:55.938027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5b1a84796f45c286f387ab548e19f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:55.947666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5b1a84796f45c286f387ab548e19f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:55.948512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5b1a84796f45c286f387ab548e19f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:55.961616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1210/2419] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:54:55 2022] DELETE /identity/v3/users/dc5b1a84796f45c286f387ab548e19f6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:54:55.966227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:55.966699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:55.966790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:55.985085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:54:55.986302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:56.047580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1210/2420] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:54:56.057252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:56.058923 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:56.118859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19926103-bcf8-4c8c-8f9d-c9548ea690d4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:56.123889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:56.124532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:56.124834 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:56.125110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:56.136450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:56.137940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:56.148558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1211/2421] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:54:56.428355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:54:56.430020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:54:56.445571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71504cff-82be-43dc-8d9a-43b170c24621 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:54:56.450914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:54:56.451980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:54:56.452258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:54:56.452516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] PATH_INFO: `/v3/projects/b7e8ca337c9644a98ff62fa62b16126e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:54:56.453844 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e8ca337c9644a98ff62fa62b16126e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:54:56.455775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:54:56.508637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e8ca337c9644a98ff62fa62b16126e', 'request_id': 'req-642a5e46-4496-43e6-ad3a-71c4a514cd08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:56.514894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e8ca337c9644a98ff62fa62b16126e', 'request_id': 'req-642a5e46-4496-43e6-ad3a-71c4a514cd08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:56.520599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e8ca337c9644a98ff62fa62b16126e', 'request_id': 'req-642a5e46-4496-43e6-ad3a-71c4a514cd08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:56.535059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] The token cache is being invalidate because project b7e8ca337c9644a98ff62fa62b16126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:54:56.535365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:56.535975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:54:56.537725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1211/2422] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:54:56 2022] DELETE /identity/v3/projects/b7e8ca337c9644a98ff62fa62b16126e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:55:04.514220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:04.515756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:04.527398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1df08-fae5-44df-9c50-0c516659491f service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:04.546786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:04.581394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:04.582050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:04.582334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:04.582608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:04.584954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:04.651386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:04.652867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cfb01-b722-40eb-97f3-795c7be85f4d service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:04.663552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1212/2423] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:55:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:55:06.532023 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:09.047301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:09.049121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:09.163180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a5e46-4496-43e6-ad3a-71c4a514cd08 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:09.168221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:09.168956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:09.169238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:09.169529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:09.171401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:09.183365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:09.185014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:09.195961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1212/2424] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:55:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:55:14.658715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=40 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:19.191227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=41 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:31.206129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be273-81c5-4dae-9fac-f509185fb83d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:31.206615 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be273-81c5-4dae-9fac-f509185fb83d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:31.206717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be273-81c5-4dae-9fac-f509185fb83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:31.273179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d62be273-81c5-4dae-9fac-f509185fb83d None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:31.274409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d62be273-81c5-4dae-9fac-f509185fb83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:31.352462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1213/2425] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:55:31.386063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:31.387745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:31.541723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042464a-ac8f-449a-8075-5f1ce9c72922 service placement] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:31.549189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:31.550482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:31.550748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:31.551027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:31.580952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:31.582774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1da67-76e6-4fe0-baa6-e735fd304489 service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:31.596772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1213/2426] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:55:41.349353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=47 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:41.591637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=41 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:55:46.077157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.077737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.078004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.080902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1214/2427] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:55:46.087459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7d1f-692e-4569-9c6d-599be908f0df None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.087985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7d1f-692e-4569-9c6d-599be908f0df None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.088109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac7d1f-692e-4569-9c6d-599be908f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.155048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a4ac7d1f-692e-4569-9c6d-599be908f0df None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:46.156869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a4ac7d1f-692e-4569-9c6d-599be908f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:46.294176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1214/2428] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:55:46.313246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:46.315150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:46.398117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ac83-5eec-403a-9a66-15af7fa09d8c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:46.402060 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:46.402711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.402991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.403266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.413828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:46.415396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef159-6cfa-4d95-aa0a-57c4f23d1b9b service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:46.427066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1215/2429] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:55:46.498306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.498730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.499058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.500781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1215/2430] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:55:46.505532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d8f3-e146-454a-8779-0b802ad00324 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.506029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d8f3-e146-454a-8779-0b802ad00324 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.506372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d8f3-e146-454a-8779-0b802ad00324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.526718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-94b7d8f3-e146-454a-8779-0b802ad00324 None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:46.527943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-94b7d8f3-e146-454a-8779-0b802ad00324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:46.534931 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1216/2431] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:55:46.546910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:46.549098 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:46.567394 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b51b2-0103-4553-b350-58f547102cd3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:46.572213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:46.573049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.573378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.574092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.583448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:46.585149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b7c25-7fef-47d1-8f1c-cd7a5e8f7523 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:46.594369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1216/2432] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:55:46.710844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d8cca-a787-496c-9420-64fce9d76bd0 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.711131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d8cca-a787-496c-9420-64fce9d76bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.711407 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d8cca-a787-496c-9420-64fce9d76bd0 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.713718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1217/2433] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:55:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:55:46.720891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15cdc-66b0-499f-bdf9-83c13b46b56c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.721426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15cdc-66b0-499f-bdf9-83c13b46b56c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.721824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab15cdc-66b0-499f-bdf9-83c13b46b56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.745645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7ab15cdc-66b0-499f-bdf9-83c13b46b56c None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:46.746641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7ab15cdc-66b0-499f-bdf9-83c13b46b56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:46.757324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1217/2434] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:55:46.775221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d8cca-a787-496c-9420-64fce9d76bd0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:46.790047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d8cca-a787-496c-9420-64fce9d76bd0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:46.795841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:46.796929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:46.797348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:46.797728 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:46.808392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:46.810087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:46.823063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1218/2435] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:55:51.415584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a072-3c70-4fd1-9cc2-4e4bcacc19dc None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:51.416144 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a072-3c70-4fd1-9cc2-4e4bcacc19dc None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:51.416225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76a072-3c70-4fd1-9cc2-4e4bcacc19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:51.434007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3d76a072-3c70-4fd1-9cc2-4e4bcacc19dc None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:51.435315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3d76a072-3c70-4fd1-9cc2-4e4bcacc19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:51.443569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1218/2436] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:55:51.456030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:55:51.468010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3fe2-18aa-474f-89d1-0fae4bf5692a service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:55:51.474365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:55:51.475002 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:51.475271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:51.475545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:51.484312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:55:51.485990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba55092-6042-4cff-a333-5f3669c2e56c service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:55:51.494248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1219/2437] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:55:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:55:54.685566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa591-446e-46cc-9137-3a0056f5d582 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:55:54.686208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa591-446e-46cc-9137-3a0056f5d582 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:55:54.686208 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31aa591-446e-46cc-9137-3a0056f5d582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:55:54.707010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-b31aa591-446e-46cc-9137-3a0056f5d582 None None] MFA Rules not processed for user `87c3f39c0bed4fadbc8a556c857baf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:55:54.708381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b31aa591-446e-46cc-9137-3a0056f5d582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:55:54.795460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1219/2438] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:01.490965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=50 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:03.973177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168632-fb52-461c-913d-f741829102bb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:03.973840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168632-fb52-461c-913d-f741829102bb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:03.973840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd168632-fb52-461c-913d-f741829102bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:03.993148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-cd168632-fb52-461c-913d-f741829102bb None None] MFA Rules not processed for user `afc8379be09748a68ade6af9b99cdfa2`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:03.994460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cd168632-fb52-461c-913d-f741829102bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:04.062600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1220/2439] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:04.774859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:14.055303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=25 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:14.234109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac826ec-984d-4865-940e-c4a7cf4323f7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:14.235471 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac826ec-984d-4865-940e-c4a7cf4323f7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:14.235957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac826ec-984d-4865-940e-c4a7cf4323f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:14.255694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-aac826ec-984d-4865-940e-c4a7cf4323f7 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:14.256966 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aac826ec-984d-4865-940e-c4a7cf4323f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:14.270877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1220/2440] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:14.278066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd168632-fb52-461c-913d-f741829102bb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:14.291260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd168632-fb52-461c-913d-f741829102bb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:14.297358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:14.298019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:14.298297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:14.298572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:14.307774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:14.309370 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:14.323275 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1221/2441] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:56:24.249950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:24.320146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=6 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:28.775983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:28.776503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:28.776607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:28.795652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:28.796895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:28.804986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1221/2442] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:28.817461 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:28.828481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f7ef7-3559-4204-b901-36d58831af4f service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:28.834074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:28.834692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:28.835025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:28.835302 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:28.843563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:28.845480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:28.853848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1222/2443] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 14:56:35.767143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:35.768851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:35.842188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a1fd-bcfb-4f37-ad4f-a9349bcac70c None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:35.847373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:35.848301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:35.848584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:35.849000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] PATH_INFO: `/v3/users/ad9a7c6755784828b967f1bef37f6441` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:35.850220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9a7c6755784828b967f1bef37f6441)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:35.852196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:35.903557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9a7c6755784828b967f1bef37f6441'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:35.904266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9a7c6755784828b967f1bef37f6441'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:35.904955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9a7c6755784828b967f1bef37f6441'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:35.914948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9a7c6755784828b967f1bef37f6441'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:35.926916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9a7c6755784828b967f1bef37f6441'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:35.939527 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1222/2444] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:56:35 2022] DELETE /identity/v3/users/ad9a7c6755784828b967f1bef37f6441 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:36.126274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:36.137779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a831a-6478-4c22-b237-5d04ba7d7a7e service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:36.195517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:36.196410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.196687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.196985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] PATH_INFO: `/v3/projects/7500725f7c744f318862323e13c5f23e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.198156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7500725f7c744f318862323e13c5f23e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:36.200054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:36.252105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7500725f7c744f318862323e13c5f23e', 'request_id': 'req-b62e6664-409a-4aad-8cab-668ab84fe00d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.259132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7500725f7c744f318862323e13c5f23e', 'request_id': 'req-b62e6664-409a-4aad-8cab-668ab84fe00d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.265791 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7500725f7c744f318862323e13c5f23e', 'request_id': 'req-b62e6664-409a-4aad-8cab-668ab84fe00d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.279860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] The token cache is being invalidate because project 7500725f7c744f318862323e13c5f23e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:56:36.280071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.280688 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.282318 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1223/2445] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:56:36 2022] DELETE /identity/v3/projects/7500725f7c744f318862323e13c5f23e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:36.286561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:36.288149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:36.302008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5faf4-22b2-47c2-aa4f-83b76615691f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:36.361833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:36.362720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.363000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.363272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] PATH_INFO: `/v3/users/6ad1e57ceaa244a0bd142f585b2cc930` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.364458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad1e57ceaa244a0bd142f585b2cc930)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:36.366627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:36.380445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:36.417534 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad1e57ceaa244a0bd142f585b2cc930'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.418296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad1e57ceaa244a0bd142f585b2cc930'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.419065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad1e57ceaa244a0bd142f585b2cc930'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.429317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad1e57ceaa244a0bd142f585b2cc930'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.442095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7f7372ff-8448-4ab5-8201-8ec41300f980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad1e57ceaa244a0bd142f585b2cc930'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.454712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1223/2446] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:56:36 2022] DELETE /identity/v3/users/6ad1e57ceaa244a0bd142f585b2cc930 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:36.647197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:36.648815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:36.662396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e6664-409a-4aad-8cab-668ab84fe00d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:36.722635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:36.723509 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.723790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.724065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] PATH_INFO: `/v3/projects/1a13f6f625ef4d2e9db262a4e561648b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.725317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a13f6f625ef4d2e9db262a4e561648b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:36.727233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:36.750640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:36.779345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a13f6f625ef4d2e9db262a4e561648b', 'request_id': 'req-d863f433-6191-4ac1-8ba6-409df810353f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.785698 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a13f6f625ef4d2e9db262a4e561648b', 'request_id': 'req-d863f433-6191-4ac1-8ba6-409df810353f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.791480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a13f6f625ef4d2e9db262a4e561648b', 'request_id': 'req-d863f433-6191-4ac1-8ba6-409df810353f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.806028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] The token cache is being invalidate because project 1a13f6f625ef4d2e9db262a4e561648b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:56:36.806340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.806968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-d863f433-6191-4ac1-8ba6-409df810353f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:56:36.808621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1224/2447] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:56:36 2022] DELETE /identity/v3/projects/1a13f6f625ef4d2e9db262a4e561648b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:36.814042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.814514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.814729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.865486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:36.866725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:36.930163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1224/2448] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:36.938438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642965-77ee-44d6-b100-a481920572f6 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.938735 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642965-77ee-44d6-b100-a481920572f6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.939023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642965-77ee-44d6-b100-a481920572f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.958468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-17642965-77ee-44d6-b100-a481920572f6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:36.959678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-17642965-77ee-44d6-b100-a481920572f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:36.968112 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1225/2449] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:36.972517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:36.982488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82e8b3-86c6-450d-9f3e-a97cffcc8562 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:36.987198 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:36.987895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:36.988128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:36.988421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:36.989180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:56:36.989486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:36.991109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.002710 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1225/2450] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:56:37.007301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642965-77ee-44d6-b100-a481920572f6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.016981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642965-77ee-44d6-b100-a481920572f6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.022944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.023607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.023880 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.024144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.024873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.026781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.055311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1226/2451] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:56:37 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:56:37.059705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.070276 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342612c8-2fc3-4442-a7cd-ece00c55fd60 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.127066 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.127728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.128006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.128275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.129000 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.130930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.139773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:37.161401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1226/2452] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:56:37 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:56:37.165676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.176861 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc4ea-69dc-4be3-8bfc-37f354d1b8ce admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.182539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.183199 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.183477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.183745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.184474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.186124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.197299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1227/2453] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:56:37.201439 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.212143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520448d-59dc-49a9-be87-a2d4915c83dc admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.217139 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.217789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.218077 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.218351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.219081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.220773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa763bc-5703-4574-9c13-646f1acee68c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.234281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1227/2454] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:56:37.240447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.255464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1276ebb-5e46-4cad-9aae-456726c0059d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.261687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.263098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.263562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.264006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] PATH_INFO: `/v3/projects/c4515b09c1944036b62a40cc5e88719e/users/3876008710b8469c9f65a24789a58067/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.287104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4515b09c1944036b62a40cc5e88719e, user_id=3876008710b8469c9f65a24789a58067, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.291527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.312725 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1228/2455] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:56:37 2022] PUT /identity/v3/projects/c4515b09c1944036b62a40cc5e88719e/users/3876008710b8469c9f65a24789a58067/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:37.318890 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3e1d2-18b2-4a5e-a448-4508a4cc953e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.319458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3e1d2-18b2-4a5e-a448-4508a4cc953e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.320049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3e1d2-18b2-4a5e-a448-4508a4cc953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.343036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7da3e1d2-18b2-4a5e-a448-4508a4cc953e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:37.344872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7da3e1d2-18b2-4a5e-a448-4508a4cc953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:37.406855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1228/2456] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:37.416727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:37.418841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:37.483789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97892e-67f8-462a-ad48-365b3feee035 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:37.488035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:37.488683 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:37.489006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:37.489279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:37.498703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:37.500138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:37.510035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1229/2457] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:56:41.706061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:41.706594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:41.706594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:41.741472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] MFA Rules not processed for user `3876008710b8469c9f65a24789a58067`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:41.742931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:41.813952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1229/2458] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:41.818621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:41.828909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b6e5a-3aa2-4a9f-ab03-cc0d317ceaaf service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:41.833622 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:41.834273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:41.834550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:41.834820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:41.835526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:41.837474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:41.866992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1230/2459] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:56:41 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:56:41.872666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:41.884200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185c720-ccb9-4d4c-8fa1-3120b0dc05c5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:41.947517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:41.948201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:41.948502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:41.948781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:41.949479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:41.951420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:41.975336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1230/2460] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:56:41 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:56:41.980744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:41.991643 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a6b3f-f264-46b7-9924-bb8bdd733d68 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:41.996545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:41.997154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:41.997436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:41.997700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:41.998450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:42.000059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:42.011081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1231/2461] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:56:42.015393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:42.020942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:42.027497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871932c1-208e-48e1-a621-3091f65cd745 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:42.033269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:42.034171 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:42.034453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:42.034724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] PATH_INFO: `/v3/projects/4b42cc6a785a4ad4bc47c68380465045/users/f4a86fe83ee24291b74549ccbc0a2774/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:42.050422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b42cc6a785a4ad4bc47c68380465045, user_id=f4a86fe83ee24291b74549ccbc0a2774, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:42.053217 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:42.067687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1231/2462] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:56:42 2022] PUT /identity/v3/projects/4b42cc6a785a4ad4bc47c68380465045/users/f4a86fe83ee24291b74549ccbc0a2774/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:42.071911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:42.082431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ff298-b0fb-41d3-b5f6-eb8df61ae0ec admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:42.092431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:42.143790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:42.144460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:42.144751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:42.145046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:42.145754 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:42.147378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097a65c-2827-40b8-a328-f7c65f61c038 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:42.157761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1232/2463] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:56:42.162621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:42.173207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9d8ba-8684-41f7-8a9e-79fb17aa1b7f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:42.178400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:42.179316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:42.179598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:42.179864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] PATH_INFO: `/v3/projects/4b42cc6a785a4ad4bc47c68380465045/users/f4a86fe83ee24291b74549ccbc0a2774/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:42.181918 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b42cc6a785a4ad4bc47c68380465045, user_id=f4a86fe83ee24291b74549ccbc0a2774, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:42.184609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:42.195819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1232/2464] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:56:42 2022] PUT /identity/v3/projects/4b42cc6a785a4ad4bc47c68380465045/users/f4a86fe83ee24291b74549ccbc0a2774/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:56:46.586182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:46.586692 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:46.586999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:46.623920 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] MFA Rules not processed for user `f4a86fe83ee24291b74549ccbc0a2774`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:56:46.625209 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:46.718221 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1233/2465] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:56:46.734986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:56:46.737060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:56:46.818913 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4828f-8b3b-4d27-abd9-2e6b80c2e5db admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:56:46.825334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:56:46.826174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:56:46.826588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:56:46.827004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:56:46.907659 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:56:46.909718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7727980-02dc-4a43-b663-1fea025f92f8 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:56:46.921285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1233/2466] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:56:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:56:56.715192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=57 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:56:56.920647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=70,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:03.040886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:03.042351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:03.123080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239a18-7dc0-4b30-8a62-fea540e8dbe7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:03.127074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:03.127932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:03.128229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:03.128493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:03.130366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:03.144951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:03.146830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:03.159340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1234/2467] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:03.393622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:03.394134 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:03.394321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:03.412053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] MFA Rules not processed for user `3876008710b8469c9f65a24789a58067`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:03.413306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:03.421741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1234/2468] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:03.471642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:03.474826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:03.594885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885665e3-79fe-4aff-8939-ed32f43139f9 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:03.601003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:03.601959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:03.602410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:03.602712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:03.604596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:03.619748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:03.621253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:03.634116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1235/2469] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:11.571164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:11.593816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cdf28-49ad-4ead-a028-b2208bcb739f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:11.598950 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:11.600517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:11.600853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:11.601130 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:11.603011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:11.724661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:11.726416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443af89-a9b5-4129-8907-0c4f9aa0d45b service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:11.742386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1235/2470] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:12.031915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:12.034135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:12.056413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592a9c0-126b-4212-bc6f-60e385270593 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:12.063065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:12.064174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:12.064469 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:12.064744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:12.067114 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:12.155187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:12.159815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:12.176180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1236/2471] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:57:16.458902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:16.459443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:16.460293 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:16.489448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] MFA Rules not processed for user `69c4f81285904da78e96a4a515ec2cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:16.490900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:16.583723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1236/2472] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:17.650264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:17.651855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:17.689521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:17.744982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62536705-580b-4e45-9e5d-b030ce28677e service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:17.750278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:17.751015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:17.751297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:17.751700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:17.753580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:17.775081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:17.775941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:17.776772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc427-b029-4a39-9852-9edafb032482 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:17.779314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:17.794219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1237/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:17.801910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96854d7b-ccf1-4cfe-97f4-5270e426405f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:17.807065 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:17.808870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:17.809363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:17.809931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] PATH_INFO: `/v3/users/afc8379be09748a68ade6af9b99cdfa2` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:17.811736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc8379be09748a68ade6af9b99cdfa2)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:17.814748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:17.872002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc8379be09748a68ade6af9b99cdfa2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:17.872666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc8379be09748a68ade6af9b99cdfa2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:17.873305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc8379be09748a68ade6af9b99cdfa2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:17.884559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc8379be09748a68ade6af9b99cdfa2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:17.900199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc8379be09748a68ade6af9b99cdfa2'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:17.913699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1237/2474] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:17 2022] DELETE /identity/v3/users/afc8379be09748a68ade6af9b99cdfa2 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:17.974498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a849d-7709-499f-9918-9944d52cc08e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:17.976971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a849d-7709-499f-9918-9944d52cc08e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:17.977476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a849d-7709-499f-9918-9944d52cc08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.002033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-730a849d-7709-499f-9918-9944d52cc08e None None] MFA Rules not processed for user `87c3f39c0bed4fadbc8a556c857baf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:18.003329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-730a849d-7709-499f-9918-9944d52cc08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:18.076292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1238/2475] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:18.153435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.155017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:18.163305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:18.262490 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11884d30-6130-4dd4-83f3-ee7e027afe9f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.268339 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.269431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.269717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.270166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] PATH_INFO: `/v3/projects/1333ac4890624e11941a2681b51b07ab` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.271460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1333ac4890624e11941a2681b51b07ab)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.273635 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.333188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1333ac4890624e11941a2681b51b07ab', 'request_id': 'req-5196799f-d2e5-47ab-a703-71764feb62e5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:18.339904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1333ac4890624e11941a2681b51b07ab', 'request_id': 'req-5196799f-d2e5-47ab-a703-71764feb62e5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:18.346042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1333ac4890624e11941a2681b51b07ab', 'request_id': 'req-5196799f-d2e5-47ab-a703-71764feb62e5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:18.361759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] The token cache is being invalidate because project 1333ac4890624e11941a2681b51b07ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:18.362123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:18.362885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5196799f-d2e5-47ab-a703-71764feb62e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:18.365389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1238/2476] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:18 2022] DELETE /identity/v3/projects/1333ac4890624e11941a2681b51b07ab => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:18.370413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.370808 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.371303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.392690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:18.393966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:18.460796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1239/2477] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:57:18.469232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.469524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.469805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.488387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:18.489671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:18.498092 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1239/2478] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:18.502636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.513226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eaf17c-7d8c-458a-9953-73f4eee87b60 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.518987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.519657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.519937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.520207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.520982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:57:18.521292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.522901 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.536246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1240/2479] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:57:18.540633 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.551647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537b87-561c-4364-9bd6-a7340771c174 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.558775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.559448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.559732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.560009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.560746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.563317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.600538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1240/2480] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:57:18 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:57:18.605606 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.624833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c068d-7ff4-4d46-b3c9-cdfd6773af06 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.686715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:18.709524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.710255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.710551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.710906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.711554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.713547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.733570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1241/2481] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:57:18 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:18.737896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.748917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8d343-c5b7-44de-90fc-eb5a2d6aeb4b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.754110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.754607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.754904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.755146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.755883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.757543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.776774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1241/2482] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:18.781054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.792283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d05d3-ba9e-447d-9744-5fecafae6dba admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.798623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.799298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.799585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.799859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.800682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.802252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95633d9b-e611-4420-9c3d-f2da29ccc1c2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.816451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1242/2483] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:18.818511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:18.830535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9a9f3-8113-42ff-bafa-cb5ddcd9819c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:18.839068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:18.839982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.840258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.840528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] PATH_INFO: `/v3/projects/5673dca5e97246a9b829e04f3642523c/users/e38285e6ba6042289e167769a3ea32e9/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.857954 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5673dca5e97246a9b829e04f3642523c, user_id=e38285e6ba6042289e167769a3ea32e9, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:18.860938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:18.877470 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1242/2484] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:18 2022] PUT /identity/v3/projects/5673dca5e97246a9b829e04f3642523c/users/e38285e6ba6042289e167769a3ea32e9/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:18.889084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:18.889619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:18.889942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:18.922089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] MFA Rules not processed for user `e38285e6ba6042289e167769a3ea32e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:18.923897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:19.015947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1243/2485] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:19.020904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.066395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:19.111899 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a770ed88-eea2-4afe-8e8e-a628aa085255 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.117242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.117875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.118209 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.118487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.119239 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.121547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.152810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1243/2486] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:57:19 2022] POST /identity/v3/projects => generated 403 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:19.157024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.169414 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032f748-e308-4a3b-bd96-e11bd88d1c28 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.227949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.228626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.228936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.229246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.229947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.231911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.255503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1244/2487] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:57:19 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:19.259597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.272854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165df9e-7c64-4e6a-8876-e152e8a4d31a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.278638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.279492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.279775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.280048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.280903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.282885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.297333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1244/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:19.299413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.310786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95767e5-9843-45c6-ae16-5779548faea2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.316724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.317637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.317911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.318179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] PATH_INFO: `/v3/projects/9a6cac0b1e364ccea79b2846aafca38e/users/8eb5a7c282874efab001a6e3a80ecd22/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.340119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cac0b1e364ccea79b2846aafca38e, user_id=8eb5a7c282874efab001a6e3a80ecd22, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.343592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.361295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1245/2489] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:19 2022] PUT /identity/v3/projects/9a6cac0b1e364ccea79b2846aafca38e/users/8eb5a7c282874efab001a6e3a80ecd22/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:19.365301 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.375925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159562ad-058a-4a1c-9d36-0b59d15e3fbe admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.432053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.433036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.433220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.433528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.434334 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.436812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8203ed-679e-4852-9637-5f85fd825fc9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.448708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1245/2490] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:19.452971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.463869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe2239-94e3-444f-8975-c0ec77db085f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.469380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.470265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.470549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.470821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] PATH_INFO: `/v3/projects/9a6cac0b1e364ccea79b2846aafca38e/users/8eb5a7c282874efab001a6e3a80ecd22/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.474007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6cac0b1e364ccea79b2846aafca38e, user_id=8eb5a7c282874efab001a6e3a80ecd22, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.478316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.495847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1246/2491] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:19 2022] PUT /identity/v3/projects/9a6cac0b1e364ccea79b2846aafca38e/users/8eb5a7c282874efab001a6e3a80ecd22/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:19.509311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.509517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.509825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.540586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] MFA Rules not processed for user `8eb5a7c282874efab001a6e3a80ecd22`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:19.541929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:19.651826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1246/2492] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:19.664491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:19.667083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:19.682565 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:19.746399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4460316-223c-449b-a34e-8f11f558010b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:19.752473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:19.753207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:19.753538 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:19.753820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:19.765141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:19.766907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d28bdf-68e0-498a-854d-7f8e8988a700 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:19.778210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1247/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:20.117368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:20.201717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:20.279049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de05ed5-c5ee-4f5d-92fa-e96b194dcb55 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:20.294755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:20.295676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:20.295965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:20.296242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] PATH_INFO: `/v3/users/e38285e6ba6042289e167769a3ea32e9` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:20.303265 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38285e6ba6042289e167769a3ea32e9)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:20.306182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:20.392330 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38285e6ba6042289e167769a3ea32e9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:20.393175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38285e6ba6042289e167769a3ea32e9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:20.395546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38285e6ba6042289e167769a3ea32e9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:20.407731 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38285e6ba6042289e167769a3ea32e9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:20.438321 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38285e6ba6042289e167769a3ea32e9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:20.470430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1247/2494] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:20 2022] DELETE /identity/v3/users/e38285e6ba6042289e167769a3ea32e9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:20.475369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:20.475807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:20.476182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:20.508959 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:20.511505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:20.599146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1248/2495] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:20.652430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:20.655093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:20.738679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bfa32f-fd24-475c-a1a4-cbb7fe05fcf1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:20.743401 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:20.744140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:20.744421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:20.744740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:20.756050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:20.757889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:20.769121 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1248/2496] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:21.521016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:21.522654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:21.561824 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec92a97-1dce-479f-bad9-5b19c4f5297e None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:21.574624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:21.575772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:21.576266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:21.576832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] PATH_INFO: `/v3/projects/5673dca5e97246a9b829e04f3642523c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:21.578977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5673dca5e97246a9b829e04f3642523c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:21.581398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:21.655158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5673dca5e97246a9b829e04f3642523c', 'request_id': 'req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.663960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5673dca5e97246a9b829e04f3642523c', 'request_id': 'req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.672869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5673dca5e97246a9b829e04f3642523c', 'request_id': 'req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.691215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] The token cache is being invalidate because project 5673dca5e97246a9b829e04f3642523c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:21.691924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.694244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.697371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1249/2497] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:21 2022] DELETE /identity/v3/projects/5673dca5e97246a9b829e04f3642523c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:21.701141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:21.716155 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad284b4-9a20-4e37-9d36-408af549fb84 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:21.792700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:21.808707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:21.809654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:21.811012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:21.812190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] PATH_INFO: `/v3/users/8eb5a7c282874efab001a6e3a80ecd22` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:21.817314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb5a7c282874efab001a6e3a80ecd22)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:21.820569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:21.886858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb5a7c282874efab001a6e3a80ecd22'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.887941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb5a7c282874efab001a6e3a80ecd22'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.888578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb5a7c282874efab001a6e3a80ecd22'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.899978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb5a7c282874efab001a6e3a80ecd22'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.919570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-6ea7b865-2e02-477c-9d22-cabe70b4d2c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb5a7c282874efab001a6e3a80ecd22'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:21.942323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1249/2498] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:21 2022] DELETE /identity/v3/users/8eb5a7c282874efab001a6e3a80ecd22 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:22.361530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:22.365815 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:22.387198 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3ab4e-fcad-45d7-951d-9a2f6a3f698c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:22.446748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:22.502157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:22.503345 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.503799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.504648 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] PATH_INFO: `/v3/projects/9a6cac0b1e364ccea79b2846aafca38e` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.505652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6cac0b1e364ccea79b2846aafca38e)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:22.507734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:22.587874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6cac0b1e364ccea79b2846aafca38e', 'request_id': 'req-8c46340f-9f81-44fc-87a4-c3db0a57454e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:22.594278 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6cac0b1e364ccea79b2846aafca38e', 'request_id': 'req-8c46340f-9f81-44fc-87a4-c3db0a57454e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:22.599623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6cac0b1e364ccea79b2846aafca38e', 'request_id': 'req-8c46340f-9f81-44fc-87a4-c3db0a57454e'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:22.613526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] The token cache is being invalidate because project 9a6cac0b1e364ccea79b2846aafca38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:22.613747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:22.614357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8c46340f-9f81-44fc-87a4-c3db0a57454e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:22.615916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1250/2499] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:22 2022] DELETE /identity/v3/projects/9a6cac0b1e364ccea79b2846aafca38e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:22.620938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.621227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.621500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.640646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:22.641902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:22.702810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1250/2500] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:22.710778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.711083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.711359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.732600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:22.734043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:22.744553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1251/2501] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:22.749526 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:22.760307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84291616-ae2a-42ff-861e-a816b2a23721 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:22.766911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:22.767588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.767865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.768170 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.769009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:57:22.769315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:22.771019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:22.785158 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1251/2502] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:57:22.790295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:22.804176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f383b-06ab-4380-ba8d-7fd2f57697e4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:22.819678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:22.820404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.820926 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.821298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.822050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:22.824078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:22.857641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1252/2503] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:57:22 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:22.862018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:22.876105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9055b38-e0f7-4f1f-922f-e0f2af03dfa9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:22.952573 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:22.965621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:22.966730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:22.967181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:22.968031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:22.969051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:22.970893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.005539 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1252/2504] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:57:22 2022] POST /identity/v3/users => generated 278 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:23.008859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.027245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd8b85-5da3-4cca-97ba-0a2a26d380d1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.034037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.034763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.035047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.035327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.036146 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.037814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.050263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1253/2505] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:57:23.054378 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.065614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd2992-a56b-44b9-9be3-e40acdd39269 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.070501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.071199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.071486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.071761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.072500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.074205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1d723-ee15-4fa0-975b-f49b40bf46f3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.090798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1253/2506] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:23.092596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.106353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aa3f5-013a-47f7-8f19-7c5076a4b462 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.114265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.115803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.116329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.116737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] PATH_INFO: `/v3/projects/0fef28567ed447eaa458c23c1fa289f7/users/d7fa342f8972453686a0cbf52badc6a4/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.144287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fef28567ed447eaa458c23c1fa289f7, user_id=d7fa342f8972453686a0cbf52badc6a4, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.147124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.166074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1254/2507] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:23 2022] PUT /identity/v3/projects/0fef28567ed447eaa458c23c1fa289f7/users/d7fa342f8972453686a0cbf52badc6a4/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:23.176945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.177348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.177737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.210393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] MFA Rules not processed for user `d7fa342f8972453686a0cbf52badc6a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:23.211762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:23.288451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1254/2508] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:23.293256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.371019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbee7d7-72e6-4896-bd09-65758bac3b71 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.375918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.376611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.376922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.377197 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.377898 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.379855 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.383405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:23.417452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1255/2509] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:57:23 2022] POST /identity/v3/projects => generated 355 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:23.418684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.432558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683b8a7-2e44-45a2-a6fb-c74903e968a1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.511133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.511856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.512138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.512414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.513192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.515372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.538108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1255/2510] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:57:23 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:23.542185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.554128 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f60f-218f-42a8-a572-b455187368f2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.559130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.560042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.560564 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.560915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.562203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.564936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.577193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1256/2511] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:57:23.582376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.593894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07d255-b8ce-4c3f-998f-ea95a1470af0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.608410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.609406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.609685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.609956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] PATH_INFO: `/v3/projects/453b755abc56416998755b7242e4e9b3/users/f986e06ab666493fbb4f65e0b0a2c6b5/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.628628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=453b755abc56416998755b7242e4e9b3, user_id=f986e06ab666493fbb4f65e0b0a2c6b5, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.631641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.648319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1256/2512] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:23 2022] PUT /identity/v3/projects/453b755abc56416998755b7242e4e9b3/users/f986e06ab666493fbb4f65e0b0a2c6b5/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:23.652388 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.666308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e9f8f-9ca7-4dc8-ab93-14d495d2a9ac admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.736075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.736803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.737077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.737352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.738091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.739708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75976f14-3b30-4df4-a7ef-037e0193f410 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.755162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1257/2513] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:23.756558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.768282 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e03b58-7b5b-4d16-96d0-c117901ea7fb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:23.774533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:23.775520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.775988 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.776325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] PATH_INFO: `/v3/projects/453b755abc56416998755b7242e4e9b3/users/f986e06ab666493fbb4f65e0b0a2c6b5/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.779086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=453b755abc56416998755b7242e4e9b3, user_id=f986e06ab666493fbb4f65e0b0a2c6b5, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:23.782122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:23.803431 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1257/2514] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:23 2022] PUT /identity/v3/projects/453b755abc56416998755b7242e4e9b3/users/f986e06ab666493fbb4f65e0b0a2c6b5/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:23.807578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:23.807875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:23.808191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:23.842730 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] MFA Rules not processed for user `f986e06ab666493fbb4f65e0b0a2c6b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:23.844494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:23.920990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1258/2515] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:23.937852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:23.939701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:23.961229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:24.003385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583ffaf-906f-4d68-b3d6-c9620eb4ef24 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:24.007387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:24.008050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:24.008360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:24.008598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:24.018601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:24.020127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:24.030637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1258/2516] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:24.119723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:24.130821 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d8cad-f9e7-4936-b8d1-951ab90faac3 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:24.143264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:24.144264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:24.144557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:24.144895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:24.234493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:24.247970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:24.250816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:24.266088 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1259/2517] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:25.216084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:25.217591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:25.277447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa850df-79e7-42ef-898d-0e6fb8e7436a service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:25.282462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:25.283106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:25.283388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:25.283661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:25.285689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:25.351504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:25.352998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:25.363154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1259/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:28.149044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:28.151042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:28.168899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792ef85-8635-45a9-a73c-a16f9a72ab7a service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:28.174137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:28.175079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:28.175743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:28.176177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:28.178568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:28.198567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:28.201812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e392-cff1-4a19-8261-f521067a97a5 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:28.221067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1260/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:35.358396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=69 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:38.209313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=9 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:39.430163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:39.496955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4003f-07a4-42b8-aa29-87e50fb89f5e service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:39.502432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:39.503315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:39.503596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:39.503871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] PATH_INFO: `/v3/users/d7fa342f8972453686a0cbf52badc6a4` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:39.505233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7fa342f8972453686a0cbf52badc6a4)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:39.507186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:39.557480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7fa342f8972453686a0cbf52badc6a4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:39.558143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7fa342f8972453686a0cbf52badc6a4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:39.558792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7fa342f8972453686a0cbf52badc6a4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:39.567648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7fa342f8972453686a0cbf52badc6a4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:39.579974 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7fa342f8972453686a0cbf52badc6a4'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:39.592961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1260/2520] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:39 2022] DELETE /identity/v3/users/d7fa342f8972453686a0cbf52badc6a4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:39.597878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:39.598364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:39.598467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:39.616968 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:39.618192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:39.687973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1261/2521] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:39.699689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:39.701396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:39.766240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387f1e7-7460-49bf-beef-f5afef9bfedb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:39.770784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:39.771435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:39.771713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:39.771986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:39.781656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:39.783266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:39.792984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1261/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:40.074054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:40.075751 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:40.090285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6023e-57ce-4ded-8aee-7057357465c4 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:40.095587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:40.097166 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.097707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.097900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] PATH_INFO: `/v3/projects/0fef28567ed447eaa458c23c1fa289f7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.099220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fef28567ed447eaa458c23c1fa289f7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:40.101309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:40.153264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fef28567ed447eaa458c23c1fa289f7', 'request_id': 'req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.161915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fef28567ed447eaa458c23c1fa289f7', 'request_id': 'req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.168518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fef28567ed447eaa458c23c1fa289f7', 'request_id': 'req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.183127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] The token cache is being invalidate because project 0fef28567ed447eaa458c23c1fa289f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:40.183416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.184044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.185675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1262/2523] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:40 2022] DELETE /identity/v3/projects/0fef28567ed447eaa458c23c1fa289f7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:40.190997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:40.205989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0028db-a169-442a-ae71-a0246cfc814a service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:40.225948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:40.265078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:40.265961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.266242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.266519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] PATH_INFO: `/v3/users/f986e06ab666493fbb4f65e0b0a2c6b5` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.267798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f986e06ab666493fbb4f65e0b0a2c6b5)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:40.269802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:40.324073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f986e06ab666493fbb4f65e0b0a2c6b5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.324758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f986e06ab666493fbb4f65e0b0a2c6b5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.325509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f986e06ab666493fbb4f65e0b0a2c6b5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.334610 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f986e06ab666493fbb4f65e0b0a2c6b5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.346684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-478081d0-baed-494d-a89a-70f71b4d5da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f986e06ab666493fbb4f65e0b0a2c6b5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.359445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1262/2524] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:40 2022] DELETE /identity/v3/users/f986e06ab666493fbb4f65e0b0a2c6b5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:40.651902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:40.653491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:40.667714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a85abe-0f7e-4f16-a46a-e94c0e013aaa admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:40.725405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:40.726220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.726497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.726788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] PATH_INFO: `/v3/projects/453b755abc56416998755b7242e4e9b3` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.727981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=453b755abc56416998755b7242e4e9b3)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:40.729944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:40.764684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:40.782755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '453b755abc56416998755b7242e4e9b3', 'request_id': 'req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.788941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '453b755abc56416998755b7242e4e9b3', 'request_id': 'req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.795031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '453b755abc56416998755b7242e4e9b3', 'request_id': 'req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.810131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] The token cache is being invalidate because project 453b755abc56416998755b7242e4e9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:40.810419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.811392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f5b2990c-8bb5-485b-a55b-0ab6271fdcf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:40.812997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1263/2525] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:40 2022] DELETE /identity/v3/projects/453b755abc56416998755b7242e4e9b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:40.818993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.819468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.819562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.838353 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:40.839587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:40.903205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1263/2526] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:40.912001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.912293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.912575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.932939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:40.934168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:40.944113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1264/2527] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:40.948749 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:40.959117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8bd8a-29dc-49f5-88e9-dacc6c5908c9 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:40.965733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:40.966414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:40.966691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:40.966968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:40.967697 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:57:40.968015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:40.969700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:40.982114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1264/2528] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:57:40.986530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:40.996237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7719a3-859b-4342-8917-8ba13dddfe27 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.001487 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.002134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.002442 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.002686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.003394 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.005342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.033796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1265/2529] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:57:40 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:41.038292 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:41.049159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f735aa-959d-47eb-b8b7-e239b0d5f8ad admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.077768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:41.112116 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.112780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.113101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.113372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.114061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.116029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.138517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1265/2530] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:57:41 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:57:41.142852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:41.153578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ab1e5-026f-4267-9a36-0dab304b2286 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.159431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.160092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.160372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.160646 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.161395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.163001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.174092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1266/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:57:41.178033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:41.188656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c610f9-5835-4948-8d1a-4bf6ddc33353 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.193952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.194608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.194917 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.195186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.195916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.197609 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae9b71-228e-41b7-9b27-7d51ff3d5ca8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.208264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1266/2532] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:57:41.212436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:41.222677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb5d74-e273-4019-a411-4e2572185d90 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.227760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.228633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.228941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.229210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] PATH_INFO: `/v3/projects/b5673ae843ed45099f836c5346ae88d0/users/32e8824063744bc38231b8bc8eb88297/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.244001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5673ae843ed45099f836c5346ae88d0, user_id=32e8824063744bc38231b8bc8eb88297, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.246611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.261888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1267/2533] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:57:41 2022] PUT /identity/v3/projects/b5673ae843ed45099f836c5346ae88d0/users/32e8824063744bc38231b8bc8eb88297/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:41.273889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.274181 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.274460 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.304481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] MFA Rules not processed for user `32e8824063744bc38231b8bc8eb88297`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:41.305779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:41.372085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1267/2534] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:41.384400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:41.387068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:41.455430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d5c01-285d-4524-82a3-561edf335b8b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:41.460072 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:41.460737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:41.461026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:41.461293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:41.470607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:41.472271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d701c2a-ebb4-413c-996e-dcb6abdfe1d1 service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:41.481625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1268/2535] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:51.368990 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:51.477191 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:59.137529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:59.207461 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f213cc5-e503-4e81-83da-e64f7a41b865 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:59.213049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:59.213928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:59.214211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:59.214483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] PATH_INFO: `/v3/users/32e8824063744bc38231b8bc8eb88297` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:59.215758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e8824063744bc38231b8bc8eb88297)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:59.217745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:59.273484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e8824063744bc38231b8bc8eb88297'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.274159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e8824063744bc38231b8bc8eb88297'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.274804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e8824063744bc38231b8bc8eb88297'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.284336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e8824063744bc38231b8bc8eb88297'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.296513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e8824063744bc38231b8bc8eb88297'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.309519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1268/2536] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:57:59 2022] DELETE /identity/v3/users/32e8824063744bc38231b8bc8eb88297 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:59.315012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:59.315536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:59.315536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:59.334264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:59.335519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:59.398329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1269/2537] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:57:59.408703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:59.411002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:59.474562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0bc49-8747-4ac1-b0c5-8411d707daeb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:59.480233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:59.480969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:59.481252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:59.481565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:59.492547 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:59.494097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0ab92-d374-4926-8c75-2c45a058bccb service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:59.506403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1269/2538] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:57:59.794226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:57:59.795758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:59.809266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b434fb-2e98-4262-a5dc-c2f53cdd8e58 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:57:59.815234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:57:59.816136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:59.816436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:59.816777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] PATH_INFO: `/v3/projects/b5673ae843ed45099f836c5346ae88d0` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:59.818085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5673ae843ed45099f836c5346ae88d0)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:57:59.820581 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:57:59.871755 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5673ae843ed45099f836c5346ae88d0', 'request_id': 'req-714ec03d-0cde-401e-a895-656bc0c5e427'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.877890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5673ae843ed45099f836c5346ae88d0', 'request_id': 'req-714ec03d-0cde-401e-a895-656bc0c5e427'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.883374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5673ae843ed45099f836c5346ae88d0', 'request_id': 'req-714ec03d-0cde-401e-a895-656bc0c5e427'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.895123 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] The token cache is being invalidate because project b5673ae843ed45099f836c5346ae88d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:57:59.895404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.896046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-714ec03d-0cde-401e-a895-656bc0c5e427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:57:59.897691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1270/2539] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:57:59 2022] DELETE /identity/v3/projects/b5673ae843ed45099f836c5346ae88d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:57:59.902912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:57:59.903256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:57:59.903596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:57:59.922070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:57:59.923310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:57:59.941377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:57:59.998705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1270/2540] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:00.006631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.006899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.007234 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.026806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:00.028052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:00.036649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1271/2541] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:00.041407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.052141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe0f42-06d3-47ba-8676-9283c79aa05b None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.058891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.059593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.059875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.060145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.061246 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:58:00.061557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.063263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.076336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1271/2542] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:58:00.081089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.091651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5818709-03fa-4299-bf65-09ec7745301c None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.097569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.098224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.098506 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.098776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.099471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.101512 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.130037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1272/2543] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:00.134613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.145332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea4d59-c498-4e2e-8403-39b63a23b95f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.205064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.205734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.206018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.206299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.207001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.208967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.230704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1272/2544] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:00.235347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.246668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d3dfc-7533-49b3-acc5-e82e3ff8141b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.251966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.252618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.252929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.253201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.253929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.255521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.266482 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1273/2545] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:00.270409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.280928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204276e8-a8e1-4070-8ae6-50aaa4f70639 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.286075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.286784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.287093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.287370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.288093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.289820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2995af-f18c-4bab-974c-40920ad7fc66 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.300060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1273/2546] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:00.308133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.324450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92120475-ae0c-4bbb-847c-345beb11f2b4 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.332484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.333933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.334386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.334750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] PATH_INFO: `/v3/projects/6b51ffa1a22c4188b7e16dfdca902694/users/3056daec9e344beaa1c088e8deff5559/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.350871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b51ffa1a22c4188b7e16dfdca902694, user_id=3056daec9e344beaa1c088e8deff5559, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.353582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.368674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1274/2547] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:00 2022] PUT /identity/v3/projects/6b51ffa1a22c4188b7e16dfdca902694/users/3056daec9e344beaa1c088e8deff5559/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:00.379596 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.379942 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.380225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.407006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] MFA Rules not processed for user `3056daec9e344beaa1c088e8deff5559`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:00.408218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:00.473355 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1274/2548] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:00.477997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.500306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:00.541387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77febbbe-5934-43ca-bf99-900596123d9e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.546459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.547104 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.547380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.547653 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.548346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.550280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.577603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1275/2549] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:00.581843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.592805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd885d-27f8-477d-85cf-cf897d17bc63 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.604819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:00.652898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.653562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.653842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.654111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.654795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.656758 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.683726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1275/2550] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:00.689276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.702240 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108dc42-a156-4a0f-b587-da19c95e24ad admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.707227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.707878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.708158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.708430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.709188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.710951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.721769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1276/2551] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:00.726086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.736446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d9c77-1e1d-4f92-815b-916f96954b0f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.742051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.742706 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.743003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.743253 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.743971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.745613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30394990-5ab1-4fb9-8367-4fdc96ed696b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.755705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1276/2552] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:00.760129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.770252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3849628-474c-4276-b341-f8dd42f3e58d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:00.775619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:00.776486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.776745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.777070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] PATH_INFO: `/v3/projects/7febb572c4a64e8d8c366c0e2cfafed4/users/7d981d70bd074410a59bf02ee6251369/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.793055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=7febb572c4a64e8d8c366c0e2cfafed4, user_id=7d981d70bd074410a59bf02ee6251369, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:00.795698 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:00.811585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1277/2553] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:00 2022] PUT /identity/v3/projects/7febb572c4a64e8d8c366c0e2cfafed4/users/7d981d70bd074410a59bf02ee6251369/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:00.827663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:00.827946 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:00.828241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:00.854848 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] MFA Rules not processed for user `7d981d70bd074410a59bf02ee6251369`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:00.856062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:00.927227 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1277/2554] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:00.932205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:00.995985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722eb6ab-80d4-45b2-861c-d4f76b6f5aab admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.001657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.002379 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.002659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.002933 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.003640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.005631 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.038867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1278/2555] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:00 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:01.043220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.054114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5af57-0a28-468f-9f81-adaef7e06743 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.127560 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.128233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.128515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.128825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.129537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.131501 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.155042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1278/2556] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:01 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:58:01.160793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.176844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7240f-2a37-4074-b216-a2f44919cddb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.183365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.184028 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.184367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.184574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.185535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.187599 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.198268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1279/2557] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:01.202557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.213550 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45ef56-a4ea-48bd-9e37-3b28307e2bcc admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.219379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.220268 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.220549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.220859 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] PATH_INFO: `/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956/users/23a654a07eaa415a877f9699a8a4f821/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.234096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:01.237612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9e4b8daf0a45f19efcfef4c03c7956, user_id=23a654a07eaa415a877f9699a8a4f821, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.240542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.255643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1279/2558] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:01 2022] PUT /identity/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956/users/23a654a07eaa415a877f9699a8a4f821/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:01.259794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.270099 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4e3b-5c64-4555-9641-dab09b270232 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.315416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:01.337167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.337851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.338130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.338397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.339119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.340738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3e75d-96e7-4447-a29d-07583313f90b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.350911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1280/2559] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:01.355583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.366536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cf293-5b22-43b4-ba30-8fca233cc03c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.371676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.372553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.373514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.373816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] PATH_INFO: `/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956/users/23a654a07eaa415a877f9699a8a4f821/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.376114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c9e4b8daf0a45f19efcfef4c03c7956, user_id=23a654a07eaa415a877f9699a8a4f821, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.378903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.391199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1280/2560] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:01 2022] PUT /identity/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956/users/23a654a07eaa415a877f9699a8a4f821/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:01.401647 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.402132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.402452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.430642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] MFA Rules not processed for user `23a654a07eaa415a877f9699a8a4f821`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:01.431894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:01.505346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1281/2561] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:01.517981 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:01.520591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:01.592549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d380c-e5b7-4dd1-b51f-cbb13f3537a2 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:01.599445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:01.600380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:01.600784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:01.601167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:01.668310 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:01.669801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:01.678955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1281/2562] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:03.199446 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:03.201190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:03.216075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec26476-a9c4-4f23-83b7-2cbad1408459 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:03.220817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:03.221489 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:03.221764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:03.222018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:03.292383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:03.293876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:03.303899 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1282/2563] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:03.862669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:03.872574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa840f75-da2e-4879-bdce-f744ab821bd0 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:03.876582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:03.877270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:03.877563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:03.877843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:03.888214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:03.889733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3e8d6-d0c8-4dde-8e54-9ffad2766e1a service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:03.899511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1282/2564] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:07.807918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:07.879061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4f341-9762-42e1-bd51-8c477e0fe7a4 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:07.884227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:07.885181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:07.885458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:07.885723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] PATH_INFO: `/v3/users/3056daec9e344beaa1c088e8deff5559` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:07.886947 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3056daec9e344beaa1c088e8deff5559)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:07.889156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:07.894327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:07.948513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3056daec9e344beaa1c088e8deff5559'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:07.949268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3056daec9e344beaa1c088e8deff5559'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:07.960865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3056daec9e344beaa1c088e8deff5559'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:07.970814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3056daec9e344beaa1c088e8deff5559'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:07.971429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3056daec9e344beaa1c088e8deff5559'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:07.983617 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1283/2565] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:07 2022] DELETE /identity/v3/users/3056daec9e344beaa1c088e8deff5559 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:07.988273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:07.988807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:07.988909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:08.008238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:08.009489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:08.072498 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1283/2566] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:08.083761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:08.085868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:08.161770 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68e9f0-c0c4-4d25-8525-5d4837f7ac31 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:08.166330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:08.166997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:08.167419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:08.167703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:08.177532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:08.178981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:08.189257 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1284/2567] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:08.467872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:08.469452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:08.482206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0b1de3-b350-430d-a94e-04dec2ce6d4f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:08.487445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:08.488328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:08.488612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:08.488911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] PATH_INFO: `/v3/projects/6b51ffa1a22c4188b7e16dfdca902694` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:08.490236 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b51ffa1a22c4188b7e16dfdca902694)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:08.492211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:08.509877 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:08.542530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b51ffa1a22c4188b7e16dfdca902694', 'request_id': 'req-a254f38d-b564-4ae4-9535-b94b16eb7084'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.548677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b51ffa1a22c4188b7e16dfdca902694', 'request_id': 'req-a254f38d-b564-4ae4-9535-b94b16eb7084'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.554642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b51ffa1a22c4188b7e16dfdca902694', 'request_id': 'req-a254f38d-b564-4ae4-9535-b94b16eb7084'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.570975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] The token cache is being invalidate because project 6b51ffa1a22c4188b7e16dfdca902694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:08.571218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.571864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.578082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:08.578281 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1284/2568] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:08 2022] DELETE /identity/v3/projects/6b51ffa1a22c4188b7e16dfdca902694 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:08.588699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecfbca5-d084-4ebc-b895-bcd59bfe1c3e service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:08.651274 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:08.652406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:08.652541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:08.652865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] PATH_INFO: `/v3/users/7d981d70bd074410a59bf02ee6251369` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:08.654168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d981d70bd074410a59bf02ee6251369)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:08.656097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:08.688010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:08.707453 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d981d70bd074410a59bf02ee6251369'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.708095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d981d70bd074410a59bf02ee6251369'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.720248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d981d70bd074410a59bf02ee6251369'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.729352 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d981d70bd074410a59bf02ee6251369'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.730064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d981d70bd074410a59bf02ee6251369'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:08.743200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1285/2569] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:08 2022] DELETE /identity/v3/users/7d981d70bd074410a59bf02ee6251369 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:09.031191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:09.032914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:09.047014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f38d-b564-4ae4-9535-b94b16eb7084 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:09.104744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:09.105550 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.105830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.106189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] PATH_INFO: `/v3/projects/7febb572c4a64e8d8c366c0e2cfafed4` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.107398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7febb572c4a64e8d8c366c0e2cfafed4)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:09.109356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:09.155455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7febb572c4a64e8d8c366c0e2cfafed4', 'request_id': 'req-4f9241f0-01f3-4818-abe1-08f07aab80b9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.162063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7febb572c4a64e8d8c366c0e2cfafed4', 'request_id': 'req-4f9241f0-01f3-4818-abe1-08f07aab80b9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.168078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7febb572c4a64e8d8c366c0e2cfafed4', 'request_id': 'req-4f9241f0-01f3-4818-abe1-08f07aab80b9'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.181643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] The token cache is being invalidate because project 7febb572c4a64e8d8c366c0e2cfafed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:09.181925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.182550 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.184232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1285/2570] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:09 2022] DELETE /identity/v3/projects/7febb572c4a64e8d8c366c0e2cfafed4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:09.188964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:09.190459 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:09.204124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a3160-bcc6-446e-a471-a1c79c5fafd3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:09.264807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:09.265704 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.266004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.266284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] PATH_INFO: `/v3/users/23a654a07eaa415a877f9699a8a4f821` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.267591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a654a07eaa415a877f9699a8a4f821)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:09.269589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:09.320056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a654a07eaa415a877f9699a8a4f821'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.320706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a654a07eaa415a877f9699a8a4f821'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.332363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a654a07eaa415a877f9699a8a4f821'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.341434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a654a07eaa415a877f9699a8a4f821'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.342073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-aaeed41c-65f6-4f1d-abde-9fc689ee13b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a654a07eaa415a877f9699a8a4f821'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.354253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1286/2571] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:09 2022] DELETE /identity/v3/users/23a654a07eaa415a877f9699a8a4f821 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:09.631540 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:09.633172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:09.648383 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9241f0-01f3-4818-abe1-08f07aab80b9 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:09.681977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:09.710165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:09.711047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.711329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.711629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] PATH_INFO: `/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.712852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c9e4b8daf0a45f19efcfef4c03c7956)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:09.714824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:09.763630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c9e4b8daf0a45f19efcfef4c03c7956', 'request_id': 'req-75889657-be47-4311-8987-53a2c012a83c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.769875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c9e4b8daf0a45f19efcfef4c03c7956', 'request_id': 'req-75889657-be47-4311-8987-53a2c012a83c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.775629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c9e4b8daf0a45f19efcfef4c03c7956', 'request_id': 'req-75889657-be47-4311-8987-53a2c012a83c'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.788871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] The token cache is being invalidate because project 3c9e4b8daf0a45f19efcfef4c03c7956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:09.789161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.789767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-75889657-be47-4311-8987-53a2c012a83c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:09.791311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1286/2572] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:09 2022] DELETE /identity/v3/projects/3c9e4b8daf0a45f19efcfef4c03c7956 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:09.797515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.797805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.798082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.817553 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:09.818793 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:09.839862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:09.885406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1287/2573] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:09.893556 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.893932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.894207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.916993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:09.919487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:09.929424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1287/2574] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:09.933892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:09.945922 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8780-c81c-457a-8b69-0445fa034899 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:09.951696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:09.952363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.952642 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.952953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.953696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:58:09.953994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:09.955597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:09.968160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1288/2575] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:58:09.972780 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:09.982542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732906c0-4d91-4501-a84c-161f01874f86 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:09.987446 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:09.988111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:09.988390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:09.988665 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:09.989375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:09.992149 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.023101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1288/2576] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:09 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:10.028696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:10.038364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f0cd1-b4f9-4777-8492-c96a0cd618ef admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:10.104727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:10.105432 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.105706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.106022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.106724 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:10.108883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.132245 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1289/2577] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:10 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:10.136468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:10.147671 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aa5dc-45bc-496d-9fb5-bbea11df12eb admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:10.153046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:10.153836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.154105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.154380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.155111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:10.156809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.170865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1289/2578] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:10.174977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:10.186368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6966b-6ef4-4e57-ab0c-68c2a5d25876 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:10.191715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:10.192435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.192696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.193005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.193895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:10.195502 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d2e612-7e3c-43d1-a513-a3ab440aac1b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.209613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1290/2579] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:10.210928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:10.221809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed43e5-94dc-4303-b6b6-19e654ab905a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:10.227473 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:10.228435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.228737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.229107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] PATH_INFO: `/v3/projects/9a3113610cec48debcae1934d22fec2a/users/15a6c2cccaf742b6a6b82734d7967572/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.245467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a3113610cec48debcae1934d22fec2a, user_id=15a6c2cccaf742b6a6b82734d7967572, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:10.248347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.263813 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1290/2580] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:10 2022] PUT /identity/v3/projects/9a3113610cec48debcae1934d22fec2a/users/15a6c2cccaf742b6a6b82734d7967572/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:10.275800 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941da1-1b17-43db-8428-89add170cb6a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.276161 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941da1-1b17-43db-8428-89add170cb6a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.276513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00941da1-1b17-43db-8428-89add170cb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.311460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-00941da1-1b17-43db-8428-89add170cb6a None None] MFA Rules not processed for user `15a6c2cccaf742b6a6b82734d7967572`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:10.312891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-00941da1-1b17-43db-8428-89add170cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:10.388010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1291/2581] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:10.399838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:10.401676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:10.462900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d8fc97-b936-43ee-963f-286833e32a5d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:10.467619 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:10.468333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:10.468630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:10.468936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:10.478057 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:10.479533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebea4a-7de4-4a5a-bcb5-9937ae4011c3 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:10.489615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1291/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:20.384989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:20.485373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:33.110790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00941da1-1b17-43db-8428-89add170cb6a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:33.112236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-00941da1-1b17-43db-8428-89add170cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:33.198749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00941da1-1b17-43db-8428-89add170cb6a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:33.205080 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:33.206047 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:33.206323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:33.206597 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:33.208481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:33.221946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:33.223766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:33.236381 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1292/2583] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:34.502576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:34.503613 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:34.504641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:34.529295 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:34.530872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:34.610002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1292/2584] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:34.680510 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:34.711190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:34.790671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d3ab-4714-4814-bac5-a8096c7160b2 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:34.797332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:34.798156 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:34.799693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:34.800491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:34.811714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:34.813592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:34.823771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1293/2585] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:58:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:36.627161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:36.645260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ec4ed-0a8e-4181-a3b4-2a69a50c7d2f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:36.652903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:36.654885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:36.655521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:36.655902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:36.658603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:36.678085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:36.681658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:36.695232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1293/2586] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:38.820627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:38.822456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:38.899964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a806ab-37a4-4a1e-94c1-f0569bb59991 service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:38.905091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:38.905762 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:38.906046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:38.906321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:38.908162 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:38.949591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:39.001630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:39.003294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:39.015412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1294/2587] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:58:42.057105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:42.059140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:42.084860 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a19649-27dd-4c44-b360-3098ccbfab8d service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:42.103713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:42.104400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:42.104708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:42.104980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:42.109125 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:42.251643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:42.256500 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:42.282838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1294/2588] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:42.549149 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:42.550636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:42.654105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:42.655821 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:42.689748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0454c7df-3e2c-4e14-9275-1b41870858b0 service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:42.708737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:42.709775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:42.710131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:42.710413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] PATH_INFO: `/v3/users/87c3f39c0bed4fadbc8a556c857baf4a` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:42.711679 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c3f39c0bed4fadbc8a556c857baf4a)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:42.713826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:42.768246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4906385-9510-4ca9-8de7-849aa45ac9cb service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:42.775300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:42.778003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:42.778718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:42.779259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:42.781729 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:42.793216 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c3f39c0bed4fadbc8a556c857baf4a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:42.795031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c3f39c0bed4fadbc8a556c857baf4a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:42.795739 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c3f39c0bed4fadbc8a556c857baf4a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:42.802850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:42.804976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:42.808379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c3f39c0bed4fadbc8a556c857baf4a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:42.822327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1295/2589] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:42.835865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c7731b11-a7f2-4e3b-bb76-4415d504bc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c3f39c0bed4fadbc8a556c857baf4a'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:42.858748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1295/2590] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:42 2022] DELETE /identity/v3/users/87c3f39c0bed4fadbc8a556c857baf4a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:43.102054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.115884 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f08eb-6a3d-4a7c-b27b-bea1bfe57a46 service placement] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.200481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.201507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.201883 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.202232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] PATH_INFO: `/v3/projects/532cbc0c846c4a528fccd85b0b8ab4d8` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.205058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] RBAC: Authorizing `identity:delete_project(project_id=532cbc0c846c4a528fccd85b0b8ab4d8)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.207015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.270998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532cbc0c846c4a528fccd85b0b8ab4d8', 'request_id': 'req-c33d898d-f343-49b5-99a5-0ad1a4c9299f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:43.279307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532cbc0c846c4a528fccd85b0b8ab4d8', 'request_id': 'req-c33d898d-f343-49b5-99a5-0ad1a4c9299f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:43.282283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:43.287814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532cbc0c846c4a528fccd85b0b8ab4d8', 'request_id': 'req-c33d898d-f343-49b5-99a5-0ad1a4c9299f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:43.305168 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] The token cache is being invalidate because project 532cbc0c846c4a528fccd85b0b8ab4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:43.305686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:43.306314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c33d898d-f343-49b5-99a5-0ad1a4c9299f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:43.312179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1296/2591] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:43 2022] DELETE /identity/v3/projects/532cbc0c846c4a528fccd85b0b8ab4d8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:43.314014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d611415-b66c-4999-a37f-80454015522e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.314541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d611415-b66c-4999-a37f-80454015522e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.314638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d611415-b66c-4999-a37f-80454015522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.321515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:43.335120 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1d611415-b66c-4999-a37f-80454015522e None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:43.336823 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1d611415-b66c-4999-a37f-80454015522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:43.416486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1296/2592] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:43.424419 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.424807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.425084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.453776 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:43.456017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:43.465299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1297/2593] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:43.469279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d611415-b66c-4999-a37f-80454015522e None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.483869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d611415-b66c-4999-a37f-80454015522e None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.489492 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.490518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.490801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.491072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.491805 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:58:43.492137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.493970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.519400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1297/2594] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:58:43.520939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.530877 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ea06d-c3c0-4902-b2b2-616bbae836e8 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.535488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.536230 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.536508 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.536805 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.537513 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.539429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.579990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1298/2595] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:43 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:43.584487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.598856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4906b2-1d04-4bf3-9d38-bbbf900b6400 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.673415 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.674097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.674377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.674650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.675346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.681628 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.707955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1298/2596] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:43 2022] POST /identity/v3/users => generated 283 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:43.709514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.722939 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63557d5-54ea-48c3-8292-90f646571dd1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.728386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.729286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.729580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.729859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.730771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.732472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.750387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1299/2597] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:43.752131 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.768700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910483ea-976d-4ed1-ad5d-582260c6385b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.774587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.775536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.776190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.776660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.777719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.780115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d8397-fdd5-4496-b503-c5b56f759455 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.793237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1299/2598] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:43.797517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:43.810204 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ec676-708c-477c-9ee8-bc9d38ba1ec1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:43.822527 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:43.823504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.823802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.824084 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] PATH_INFO: `/v3/projects/368fd4303a6e43b8b319d4e86b4ff486/users/58b4468e4d5b461eb23bebb06a0e9d07/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.852865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368fd4303a6e43b8b319d4e86b4ff486, user_id=58b4468e4d5b461eb23bebb06a0e9d07, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:43.856384 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:43.884409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1300/2599] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:43 2022] PUT /identity/v3/projects/368fd4303a6e43b8b319d4e86b4ff486/users/58b4468e4d5b461eb23bebb06a0e9d07/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:43.887781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:43.888554 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:43.889038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:43.928582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] MFA Rules not processed for user `58b4468e4d5b461eb23bebb06a0e9d07`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:43.930304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:44.018658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:44.026734 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1300/2600] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:44.038127 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:44.040025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:44.107831 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bcf42-409d-4dd4-b0dd-fcc29f757bd1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:44.113951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:44.114759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:44.115187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:44.115524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:44.126662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:44.128518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473eb97-478e-44fc-ad43-270fd1bf4a8c service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:44.139298 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1301/2601] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:44 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:47.320919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:47.322608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:47.394167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf642db-eb9a-4871-b4b9-edbad9b74dd3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:47.399154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:47.400035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:47.400311 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:47.400578 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] PATH_INFO: `/v3/users/15a6c2cccaf742b6a6b82734d7967572` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:47.401838 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a6c2cccaf742b6a6b82734d7967572)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:47.403769 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:47.454201 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a6c2cccaf742b6a6b82734d7967572'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:47.455022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a6c2cccaf742b6a6b82734d7967572'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:47.455743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a6c2cccaf742b6a6b82734d7967572'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:47.463944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a6c2cccaf742b6a6b82734d7967572'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:47.476664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a6c2cccaf742b6a6b82734d7967572'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:47.489061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1301/2602] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:47 2022] DELETE /identity/v3/users/15a6c2cccaf742b6a6b82734d7967572 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:47.493718 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:47.494177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:47.494177 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:47.511689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:47.512940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:47.575439 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1302/2603] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:47.587046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:47.588670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:47.650377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917fa1b-c549-4c08-a07e-1e8b74b290ed admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:47.654909 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:47.655555 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:47.655836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:47.656099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:47.666113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:47.667632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:47.677810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1302/2604] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:58:48.223936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:48.225763 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:48.238406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4fc2cb-287e-42a5-80da-3392bfdb3c5f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:48.243794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:48.244686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:48.245010 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:48.245280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] PATH_INFO: `/v3/projects/9a3113610cec48debcae1934d22fec2a` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:48.246585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a3113610cec48debcae1934d22fec2a)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:48.248522 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:48.261324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:48.313499 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a3113610cec48debcae1934d22fec2a', 'request_id': 'req-18969c4e-1d8d-46e0-8cf6-3394594f3182'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:48.324095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a3113610cec48debcae1934d22fec2a', 'request_id': 'req-18969c4e-1d8d-46e0-8cf6-3394594f3182'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:48.332937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a3113610cec48debcae1934d22fec2a', 'request_id': 'req-18969c4e-1d8d-46e0-8cf6-3394594f3182'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:48.353655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] The token cache is being invalidate because project 9a3113610cec48debcae1934d22fec2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:48.354052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:48.354841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-18969c4e-1d8d-46e0-8cf6-3394594f3182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:48.356911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1303/2605] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:48 2022] DELETE /identity/v3/projects/9a3113610cec48debcae1934d22fec2a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:49.542571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:49.552097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc217-a32b-478c-ac19-83d4cdbe9aa6 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:49.571160 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:49.612517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:49.613240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:49.613525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:49.613801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:49.615952 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:49.626941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:49.628451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bd560-ded7-4ba5-8e91-86e18a618d5d service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:49.637232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1303/2606] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:49.746798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:49.747376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:49.747666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:49.749212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1304/2607] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:58:49.755025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481da2-fdfc-4066-a878-b0049f065bd3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:49.755357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481da2-fdfc-4066-a878-b0049f065bd3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:49.755639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45481da2-fdfc-4066-a878-b0049f065bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:49.775586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-45481da2-fdfc-4066-a878-b0049f065bd3 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:49.776921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-45481da2-fdfc-4066-a878-b0049f065bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:49.849976 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1304/2608] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:49.861322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:49.863175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:49.923242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bdcc3-95e0-40a8-8bd7-08a970e09fed None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:49.927078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aec0cfd566b94d8798716eb95fa75a60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:49.927857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:49.928090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:49.928366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:49.939262 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:49.940685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d12405-7f1c-4f6b-880a-5b209a0fdf56 service glance] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:49.952129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1305/2609] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:58:50.024452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.024683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.024992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] PATH_INFO: `/` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.026410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1305/2610] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:58:50.032006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b29b-e469-4837-8edd-f8c734e18bb1 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.032324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b29b-e469-4837-8edd-f8c734e18bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.032607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147b29b-e469-4837-8edd-f8c734e18bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.052838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c147b29b-e469-4837-8edd-f8c734e18bb1 None None] MFA Rules not processed for user `7b6e8b195e224b68bc4d5bc0c04db9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:50.054187 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c147b29b-e469-4837-8edd-f8c734e18bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:50.061580 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1306/2611] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:50.073971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:50.075726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:50.090067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3dec-e42f-4694-82a6-44066dcdd9dd None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:50.093849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:50.094593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.094945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.095290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.103373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:50.105008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee02d8-dfee-40d9-991b-32b7d8d3e929 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:50.113338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1306/2612] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:50.196468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8b21-b11c-47ca-b749-8592e0a28b45 None None] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.196818 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8b21-b11c-47ca-b749-8592e0a28b45 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.197100 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8b21-b11c-47ca-b749-8592e0a28b45 None None] PATH_INFO: `/` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.198609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1307/2613] 10.222.0.23 () {54 vars in 921 bytes} [Mon Jun 20 14:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 20 14:58:50.203649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.204034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.204380 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.223354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] MFA Rules not processed for user `644364ac21704f9281845a8af6fa0b30`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:50.224623 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:50.234049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1307/2614] 10.222.0.23 () {58 vars in 1018 bytes} [Mon Jun 20 14:58:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:50.244806 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8b21-b11c-47ca-b749-8592e0a28b45 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:50.256970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8b21-b11c-47ca-b749-8592e0a28b45 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:50.260769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:50.261401 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.261681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.261984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.272304 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:50.273788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262dcf-8b5b-4518-ab68-1977e5fbc29f service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:50.284395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1308/2615] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:50.352421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:50.354176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:50.428598 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26060d85-4c5d-408b-a0e8-00332ae2e460 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:50.435110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:50.436081 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:50.436363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:50.436668 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:50.438637 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:50.451870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:50.453571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:50.463703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1308/2616] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:52.006361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:52.006854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:52.006941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:52.027787 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:52.029052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:52.086945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1309/2617] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:52.099140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:52.100785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:52.129553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:52.178212 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d75753-5e31-45ab-b414-8f71220d1b47 service placement] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:52.183638 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:52.184428 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:52.184729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:52.185007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:52.195614 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:52.197284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a255d2c-a87f-4d28-af27-2f1410ba2b8b service swift] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:52.214920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1309/2618] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:58:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:58:52.717077 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:52.718557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:52.751354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:52.793427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d41ddc-e4e7-4ebf-94f4-009ce13a416d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:52.798600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:52.799519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:52.799803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:52.800073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] PATH_INFO: `/v3/users/58b4468e4d5b461eb23bebb06a0e9d07` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:52.801333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b4468e4d5b461eb23bebb06a0e9d07)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:52.803774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:52.862094 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b4468e4d5b461eb23bebb06a0e9d07'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:52.862972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b4468e4d5b461eb23bebb06a0e9d07'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:52.882317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b4468e4d5b461eb23bebb06a0e9d07'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:52.894147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b4468e4d5b461eb23bebb06a0e9d07'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:52.901376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b4468e4d5b461eb23bebb06a0e9d07'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:52.920964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1310/2619] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:52 2022] DELETE /identity/v3/users/58b4468e4d5b461eb23bebb06a0e9d07 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:52.925650 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:52.925948 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:52.926273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:52.953542 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:52.955669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:53.046049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1310/2620] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:53.052759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:53.054436 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:53.116319 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1107b-2682-486f-91b9-0b029070ed8e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:53.120018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:53.120689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.121019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.121294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.131016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:53.132551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc84d24-cf67-4ee1-9a4b-e8e501edfad7 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:53.142534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1311/2621] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:58:53.500958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:53.502740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:53.518256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbcd6e7-7daf-4fa7-8087-7649be725960 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:53.524032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:53.524989 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.525272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.525693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] PATH_INFO: `/v3/projects/368fd4303a6e43b8b319d4e86b4ff486` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.526916 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368fd4303a6e43b8b319d4e86b4ff486)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:53.528887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:53.607359 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368fd4303a6e43b8b319d4e86b4ff486', 'request_id': 'req-13e4abfc-269f-493c-8bde-f4f1f9df9827'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:53.614029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368fd4303a6e43b8b319d4e86b4ff486', 'request_id': 'req-13e4abfc-269f-493c-8bde-f4f1f9df9827'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:53.621532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368fd4303a6e43b8b319d4e86b4ff486', 'request_id': 'req-13e4abfc-269f-493c-8bde-f4f1f9df9827'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:53.637403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] The token cache is being invalidate because project 368fd4303a6e43b8b319d4e86b4ff486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:53.637683 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:53.638508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-13e4abfc-269f-493c-8bde-f4f1f9df9827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:53.640119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1311/2622] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:53 2022] DELETE /identity/v3/projects/368fd4303a6e43b8b319d4e86b4ff486 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:53.646068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.646374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.646650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.664908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:53.666200 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:53.736016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:53.753970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1312/2623] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:53.763629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.763921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.764203 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.784622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:53.785929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:53.794356 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1312/2624] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:53.798777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:53.811037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10eb3-0e43-4561-96ca-1513039c6e34 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:53.816967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:53.817681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.817965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.818268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.819212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:58:53.820075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:53.822386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:53.851685 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1313/2625] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:58:53.856058 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:53.866928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905306a-a808-4afc-ae5f-9b57a5315354 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:53.872773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:53.873621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:53.874045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:53.874468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:53.875391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:53.877784 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:53.910256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1313/2626] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:53 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:53.915232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:53.926049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64afdd-7807-4371-9bcb-6258a0faa456 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:53.999561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.000330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.000681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.001054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.001857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.004424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.035575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.043422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1314/2627] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:53 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:58:54.051068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19f412-941f-4742-93e5-b606634a17a8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.057818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.058491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.058774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.059049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.059794 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.062232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.064678 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:54.074995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1314/2628] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:58:54.079075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.089665 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd73f-ddf3-4914-9902-7080b165d78d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.094645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.095594 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.095975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.096256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.097132 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.098997 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786e91-2021-452b-8f64-1068f78417c0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.112183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1315/2629] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:54.117676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.131656 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e4f8-7e8f-45d6-a20a-61d674bd4a9f admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.137186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.138122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.138414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.138691 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] PATH_INFO: `/v3/projects/5436af5daa80495691e04540343060c1/users/7677b3505a2e4c5981dd68ab5b5d343e/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.154768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5436af5daa80495691e04540343060c1, user_id=7677b3505a2e4c5981dd68ab5b5d343e, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.157491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.172288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1315/2630] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:54 2022] PUT /identity/v3/projects/5436af5daa80495691e04540343060c1/users/7677b3505a2e4c5981dd68ab5b5d343e/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:58:54.183014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.183677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.184030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.216043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] MFA Rules not processed for user `7677b3505a2e4c5981dd68ab5b5d343e`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:54.217346 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:54.289782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1316/2631] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:54.295297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.387413 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf9b90a-b8c9-4015-8510-71072324b221 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.391964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.392630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.392965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.393237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.393958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.395874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.423440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1316/2632] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:54 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:54.427832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.439434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fd989-b4b4-459e-ae57-2627fab0d23f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.494467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:54.514303 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.515416 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.515849 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.516526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.518266 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.520405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.555697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1317/2633] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:54 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:58:54.557449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.573607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacc1b-fdef-4d20-aa4b-1bf7df49d3f3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.586101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.587104 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.587661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.593352 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.594730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.596858 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.621458 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1317/2634] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:54.622707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.641271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea30d1-e210-43cd-9cfd-0eac20b2f9d9 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.646091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.647057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.647367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.647660 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] PATH_INFO: `/v3/projects/836b60c39c984574a7f70c2ee0f48cf9/users/cb0582328a8541f486be6ddacc203e21/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.669851 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=836b60c39c984574a7f70c2ee0f48cf9, user_id=cb0582328a8541f486be6ddacc203e21, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.673726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.690404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1318/2635] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:54 2022] PUT /identity/v3/projects/836b60c39c984574a7f70c2ee0f48cf9/users/cb0582328a8541f486be6ddacc203e21/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:54.702705 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.713143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c003a4a-150f-4052-8ac6-081ce0516167 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.770256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.771006 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.771296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.771570 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.772562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.774249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e7aa3d-0658-449a-bb68-91e33cb7397d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.784224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1318/2636] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:54.789107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.801605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2922e-3f77-4c9e-af52-3c9d379ec08e admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:54.814071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:54.815431 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.818203 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.818662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] PATH_INFO: `/v3/projects/836b60c39c984574a7f70c2ee0f48cf9/users/cb0582328a8541f486be6ddacc203e21/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.821451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836b60c39c984574a7f70c2ee0f48cf9, user_id=cb0582328a8541f486be6ddacc203e21, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:54.824753 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:54.837915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1319/2637] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:54 2022] PUT /identity/v3/projects/836b60c39c984574a7f70c2ee0f48cf9/users/cb0582328a8541f486be6ddacc203e21/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:54.848690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:54.849048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:54.849323 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:54.880140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] MFA Rules not processed for user `cb0582328a8541f486be6ddacc203e21`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:54.881674 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:54.917451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:54.970114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1319/2638] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:54.981760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:54.983715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:55.061476 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca018fd-c81e-434c-b7c8-78b182528073 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:55.066054 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:55.067020 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:55.067380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:55.067764 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:55.080511 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:55.081987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc541246-95ad-4ff1-bf21-4dfab8f0f4aa service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:55.092916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1320/2639] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:55.124143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:55.188286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855e1ae-8bf7-45af-9326-612ef9209930 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:55.192868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:55.193779 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:55.194240 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:55.194516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] PATH_INFO: `/v3/users/7677b3505a2e4c5981dd68ab5b5d343e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:55.195762 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7677b3505a2e4c5981dd68ab5b5d343e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:55.197743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:55.257467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7677b3505a2e4c5981dd68ab5b5d343e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.258185 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7677b3505a2e4c5981dd68ab5b5d343e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.258801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7677b3505a2e4c5981dd68ab5b5d343e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.268462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7677b3505a2e4c5981dd68ab5b5d343e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.282145 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7677b3505a2e4c5981dd68ab5b5d343e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.296709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1320/2640] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:55 2022] DELETE /identity/v3/users/7677b3505a2e4c5981dd68ab5b5d343e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:55.301437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:55.301782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:55.302089 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:55.320946 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:55.322172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:55.383567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1321/2641] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:55.394543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:55.396112 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:55.474048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:55.478228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c35477-fbe6-409b-a14c-ecbd00cf3ab4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:55.482607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:55.483275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:55.483847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:55.484176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:55.494069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:55.495577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:55.505088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1321/2642] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:55.891447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:55.893039 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:55.905268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d46f0-6556-47a1-a9db-0267b31653ea None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:55.915324 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:55.916801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:55.917141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:55.917549 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] PATH_INFO: `/v3/projects/5436af5daa80495691e04540343060c1` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:55.919142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5436af5daa80495691e04540343060c1)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:55.921627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:55.971165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:55.985029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5436af5daa80495691e04540343060c1', 'request_id': 'req-45a27967-839f-4f4a-85de-8b2201a5196f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:55.994872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5436af5daa80495691e04540343060c1', 'request_id': 'req-45a27967-839f-4f4a-85de-8b2201a5196f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.002816 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5436af5daa80495691e04540343060c1', 'request_id': 'req-45a27967-839f-4f4a-85de-8b2201a5196f'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.024803 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] The token cache is being invalidate because project 5436af5daa80495691e04540343060c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:56.025011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.026153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.028016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1322/2643] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:55 2022] DELETE /identity/v3/projects/5436af5daa80495691e04540343060c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:56.032142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:56.043377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121a616-054a-42dd-b80c-938be0af7a9f service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:56.102214 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:56.103090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.103373 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.103649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] PATH_INFO: `/v3/users/cb0582328a8541f486be6ddacc203e21` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.104904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0582328a8541f486be6ddacc203e21)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:56.106850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:56.161818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0582328a8541f486be6ddacc203e21'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.162675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0582328a8541f486be6ddacc203e21'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.163789 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0582328a8541f486be6ddacc203e21'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.178029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0582328a8541f486be6ddacc203e21'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.196983 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-21afafcb-1cfe-48be-a36e-dfc01ee37d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0582328a8541f486be6ddacc203e21'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.210499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1322/2644] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:56 2022] DELETE /identity/v3/users/cb0582328a8541f486be6ddacc203e21 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:56.533212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:56.534696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:56.552844 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a27967-839f-4f4a-85de-8b2201a5196f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:56.653456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:56.653456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.653456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.653456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] PATH_INFO: `/v3/projects/836b60c39c984574a7f70c2ee0f48cf9` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.654178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] RBAC: Authorizing `identity:delete_project(project_id=836b60c39c984574a7f70c2ee0f48cf9)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:56.654178 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:56.706628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836b60c39c984574a7f70c2ee0f48cf9', 'request_id': 'req-8ae66b32-b317-49f0-98a7-94352f07062b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.713184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836b60c39c984574a7f70c2ee0f48cf9', 'request_id': 'req-8ae66b32-b317-49f0-98a7-94352f07062b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.719000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836b60c39c984574a7f70c2ee0f48cf9', 'request_id': 'req-8ae66b32-b317-49f0-98a7-94352f07062b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.735925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] The token cache is being invalidate because project 836b60c39c984574a7f70c2ee0f48cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:56.736375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.737201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-8ae66b32-b317-49f0-98a7-94352f07062b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:56.739250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1323/2645] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:56 2022] DELETE /identity/v3/projects/836b60c39c984574a7f70c2ee0f48cf9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:56.745115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.745587 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.745922 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.767533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:56.768904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:56.845912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1323/2646] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:58:56.855121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.855408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.855679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.875314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:56.876579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:56.885485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1324/2647] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:56.890154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:56.900737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5457606-a6a0-476c-a5d1-7e0588eab399 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:56.905423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:56.906194 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.906620 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.906907 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.907658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:58:56.907965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:56.909818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:56.920440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:56.925967 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1324/2648] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:58:56.931702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:56.943158 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0587668-57ad-4a24-b4f8-9d593eca6909 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:56.950264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:56.951383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:56.951383 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:56.951550 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:56.952116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:56.954055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:56.988893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1325/2649] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:56 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:56.991337 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.022345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f3d2-4476-49c9-a158-affce4679861 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.128111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.128849 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.129138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.129420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.130142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.142053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.162051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1325/2650] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:56 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:58:57.166341 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.179091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cdbc30-23ab-4244-bf64-b58fcaf59f88 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.184003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.184679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.184994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.185628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.186363 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.187976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.198690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1326/2651] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:58:57.203108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.214309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c705980-0eca-4f85-b86f-df9013deaf0d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.219327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.220004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.220288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.220564 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.221336 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.223055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f1ced-41d6-4d8c-945a-5e9c7b2be684 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.234285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1326/2652] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:57.239462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.251759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14635c3-10ad-4006-8f04-f17687d5a4de admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.257315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.258505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.258786 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.259124 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] PATH_INFO: `/v3/projects/a8d4b5b6a8ce46698d8636f8e9e1d60b/users/a602de1b71e045de82aa8f83b41ed249/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.273708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:57.278736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8d4b5b6a8ce46698d8636f8e9e1d60b, user_id=a602de1b71e045de82aa8f83b41ed249, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.281940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.300981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1327/2653] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:57 2022] PUT /identity/v3/projects/a8d4b5b6a8ce46698d8636f8e9e1d60b/users/a602de1b71e045de82aa8f83b41ed249/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:57.311978 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.312351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.312700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.344165 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] MFA Rules not processed for user `a602de1b71e045de82aa8f83b41ed249`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:57.345447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:57.425465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1327/2654] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:57.430719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.502148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7858ec-7703-43b0-81fb-59070e7eb272 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.508001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.509119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.509576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.510012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.510978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.513287 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.542464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1328/2655] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:58:57 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:57.546772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.558480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a5a89-018d-4245-8659-ed93fdf16c58 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.614340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.615086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.615368 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.615756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.616673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.618658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.629597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:57.646898 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1328/2656] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:58:57 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:58:57.651410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.665657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f18e0f-faf8-42cc-8555-f0f46fd47b49 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.671279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.672148 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.672529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.672794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.673537 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.675155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.688181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1329/2657] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:57.692756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.703797 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff91c9-c13b-4f02-910a-e0b9895ed6d0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.708820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.709892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.710238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.710583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] PATH_INFO: `/v3/projects/63bb2cdeebde47dd818f47f582c93889/users/b1651fb4094f41a9b3d74a95f70a3c91/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.727234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bb2cdeebde47dd818f47f582c93889, user_id=b1651fb4094f41a9b3d74a95f70a3c91, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.730049 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.745793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1329/2658] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:57 2022] PUT /identity/v3/projects/63bb2cdeebde47dd818f47f582c93889/users/b1651fb4094f41a9b3d74a95f70a3c91/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:57.749976 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.760779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614760f-d14b-40bd-86bd-7c690bfc329f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.848554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.849276 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.849554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.849826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.850679 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.852447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b43d5-2f0b-4f13-b19d-41f734a3c06a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.863157 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1330/2659] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:58:57.867625 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:57.878806 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fd9-d176-44df-8a27-d0c1cec34446 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:57.883641 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:57.884548 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.884862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.885135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] PATH_INFO: `/v3/projects/63bb2cdeebde47dd818f47f582c93889/users/b1651fb4094f41a9b3d74a95f70a3c91/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.887135 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63bb2cdeebde47dd818f47f582c93889, user_id=b1651fb4094f41a9b3d74a95f70a3c91, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:57.889888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:57.901013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1330/2660] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:58:57 2022] PUT /identity/v3/projects/63bb2cdeebde47dd818f47f582c93889/users/b1651fb4094f41a9b3d74a95f70a3c91/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:57.911410 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:57.911774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:57.912049 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:57.939497 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] MFA Rules not processed for user `b1651fb4094f41a9b3d74a95f70a3c91`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:57.940636 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:57.999180 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:58.036354 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1331/2661] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:58.047774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:58.049488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:58.108097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec320ca-6fde-4d10-9e2e-5075558c5069 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:58.112594 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:58.113249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:58.113552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:58.113824 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:58.128333 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:58.130755 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78292a-eb1f-4baa-b5d4-7410595a53c0 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:58.140820 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1331/2662] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:58.579402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:58.648119 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b440-59c9-4533-bc81-60d146d6be7f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:58.652790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:58.653792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:58.654144 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:58.654485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] PATH_INFO: `/v3/users/a602de1b71e045de82aa8f83b41ed249` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:58.655825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a602de1b71e045de82aa8f83b41ed249)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:58.658253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:58.715548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a602de1b71e045de82aa8f83b41ed249'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:58.716336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a602de1b71e045de82aa8f83b41ed249'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:58.729113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a602de1b71e045de82aa8f83b41ed249'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:58.737315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a602de1b71e045de82aa8f83b41ed249'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:58.737973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a602de1b71e045de82aa8f83b41ed249'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:58.751026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1332/2663] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:58 2022] DELETE /identity/v3/users/a602de1b71e045de82aa8f83b41ed249 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:58.755885 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:58.756252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:58.756531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:58.778342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:58:58.780087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:58.849622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1332/2664] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:58:58.860746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:58.862272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:58.933159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44238e8f-b108-408c-9fcb-ba9d8e4267b2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:58.938971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:58.940048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:58.940626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:58.941217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:58.953859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:58.956048 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:58.968338 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1333/2665] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:58:59.267666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:59.269280 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:59.293639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e1a1dc-10ab-490a-bc77-5b7ea67f32f4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:59.299167 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:59.299897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:59.300286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:59.300629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] PATH_INFO: `/v3/projects/a8d4b5b6a8ce46698d8636f8e9e1d60b` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:59.302423 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8d4b5b6a8ce46698d8636f8e9e1d60b)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:59.304536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:59.355538 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8d4b5b6a8ce46698d8636f8e9e1d60b', 'request_id': 'req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.361842 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8d4b5b6a8ce46698d8636f8e9e1d60b', 'request_id': 'req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.364036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:59.369486 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8d4b5b6a8ce46698d8636f8e9e1d60b', 'request_id': 'req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.394696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] The token cache is being invalidate because project a8d4b5b6a8ce46698d8636f8e9e1d60b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:58:59.395163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.396080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.398519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1333/2666] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:59 2022] DELETE /identity/v3/projects/a8d4b5b6a8ce46698d8636f8e9e1d60b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:59.402495 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:59.412188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ff0b-8074-4a97-b4e5-a653e6cfc5e5 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:58:59.416390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:58:59.529857 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:58:59.530801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:58:59.531030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:58:59.531355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] PATH_INFO: `/v3/users/b1651fb4094f41a9b3d74a95f70a3c91` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:58:59.532678 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1651fb4094f41a9b3d74a95f70a3c91)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:58:59.534964 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:58:59.591026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1651fb4094f41a9b3d74a95f70a3c91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.591712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1651fb4094f41a9b3d74a95f70a3c91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.603359 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1651fb4094f41a9b3d74a95f70a3c91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.618206 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1651fb4094f41a9b3d74a95f70a3c91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.619029 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-7f7b0f1b-9192-476b-b3ef-62b7336ae173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1651fb4094f41a9b3d74a95f70a3c91'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:58:59.638792 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1334/2667] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:58:59 2022] DELETE /identity/v3/users/b1651fb4094f41a9b3d74a95f70a3c91 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:58:59.979391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:58:59.981807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:58:59.996014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf0b4e-2815-48d3-b5a1-8a5b7c65bd54 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.084868 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.085736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.086015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.086287 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] PATH_INFO: `/v3/projects/63bb2cdeebde47dd818f47f582c93889` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.087567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63bb2cdeebde47dd818f47f582c93889)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.089529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.147261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63bb2cdeebde47dd818f47f582c93889', 'request_id': 'req-0e7c55e6-8776-4350-865f-5042f62faf08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:00.154041 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63bb2cdeebde47dd818f47f582c93889', 'request_id': 'req-0e7c55e6-8776-4350-865f-5042f62faf08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:00.159894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63bb2cdeebde47dd818f47f582c93889', 'request_id': 'req-0e7c55e6-8776-4350-865f-5042f62faf08'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:00.173740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] The token cache is being invalidate because project 63bb2cdeebde47dd818f47f582c93889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:59:00.175080 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:00.175843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0e7c55e6-8776-4350-865f-5042f62faf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:00.177510 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1334/2668] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:58:59 2022] DELETE /identity/v3/projects/63bb2cdeebde47dd818f47f582c93889 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:00.183574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.183862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.184137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.203801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:00.205289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:00.273652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1335/2669] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:00.281569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.282111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.282111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.303767 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:00.305204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:00.314234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1335/2670] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:00.319027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.330175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761b52-7271-4550-b11b-cdf70088df6a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.336750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.338188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.338812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.339317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.341098 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:59:00.341823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.345929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.362630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1336/2671] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:59:00.368520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.382630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1662d-64e7-4c19-b51b-6d172066f885 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.388537 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.389218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.389496 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.389764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.390484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.392407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.425647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1336/2672] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:00 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:00.431058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.445467 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4625de4-b084-4646-a9f7-30d5ff50bb85 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.454756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:00.507014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.507697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.507982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.508256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.509013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.510983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.538296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1337/2673] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:00 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:00.539772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.550765 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeed7ad-32d4-46ea-9fd3-727066792ce4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.556862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.557410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.557672 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.557928 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.559168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.560897 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.576315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1337/2674] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:00.577378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.587974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a06ac4-037c-4a3f-806b-4b2d80c96b62 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.593536 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.594181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.594490 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.594760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.595494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.597283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81336e3f-fb2f-4c3f-9a2e-2f183344b564 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.608070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1338/2675] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:00.612204 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.622669 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5a558-1a56-4d39-a2f6-3a0eeba4f1c8 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.627567 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.628452 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.628894 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.629207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] PATH_INFO: `/v3/projects/0a4c83f6f6d34306ac6813bfb90e9222/users/810ada8904254801bc34c86aeb1635e7/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.645405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4c83f6f6d34306ac6813bfb90e9222, user_id=810ada8904254801bc34c86aeb1635e7, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.648632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.663432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1338/2676] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:00 2022] PUT /identity/v3/projects/0a4c83f6f6d34306ac6813bfb90e9222/users/810ada8904254801bc34c86aeb1635e7/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:00.674396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.674814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.675215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.703233 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] MFA Rules not processed for user `810ada8904254801bc34c86aeb1635e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:00.704480 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:00.775811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1339/2677] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:00.786883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:00.788738 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:00.803327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:00.848445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47452e57-1e55-4d4f-9d72-cfb6c5ad8492 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:00.852422 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:00.853088 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:00.853367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:00.853634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:00.862052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:00.863516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6c925-2fdf-4af5-9eca-affc9ed4c2fc service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:00.872812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1339/2678] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:08.317260 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:08.383978 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e505a82-f094-4ba6-aa10-41620112b5cb None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:08.389746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:08.390618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:08.390889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:08.391173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] PATH_INFO: `/v3/users/810ada8904254801bc34c86aeb1635e7` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:08.392420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] RBAC: Authorizing `identity:delete_user(user_id=810ada8904254801bc34c86aeb1635e7)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:08.394382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:08.418760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:08.449070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810ada8904254801bc34c86aeb1635e7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:08.450037 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810ada8904254801bc34c86aeb1635e7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:08.462333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810ada8904254801bc34c86aeb1635e7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:08.472358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810ada8904254801bc34c86aeb1635e7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:08.473079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810ada8904254801bc34c86aeb1635e7'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:08.486170 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1340/2679] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:59:08 2022] DELETE /identity/v3/users/810ada8904254801bc34c86aeb1635e7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:08.490814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef963d-7db7-4174-82ae-612991ae7f99 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:08.491309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef963d-7db7-4174-82ae-612991ae7f99 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:08.491410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef963d-7db7-4174-82ae-612991ae7f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:08.508901 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-15ef963d-7db7-4174-82ae-612991ae7f99 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:08.510119 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-15ef963d-7db7-4174-82ae-612991ae7f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:08.575494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1340/2680] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:08.585859 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:08.587038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:08.646138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe871540-ab28-4efe-aa02-ff347a26540b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:08.650113 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:08.650772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:08.651051 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:08.651323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:08.661336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:08.662400 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:08.662704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:08.662840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:08.662991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:08.676243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1341/2681] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:08.683786 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:08.685676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:08.748867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1341/2682] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:59:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:08.757810 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:08.759261 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:08.836612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f128d97-9c35-48bc-b210-190927a51688 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:08.842687 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:08.843348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:08.843625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:08.843894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:08.852820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:08.854430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef242712-3c7f-4811-a05b-df2dcf726b46 service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:08.864795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1342/2683] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:59:08.966833 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:08.968451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:08.992524 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c0363-8ff6-4541-bdc4-a6d9be2c6883 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:08.999138 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.000325 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.000795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.001291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] PATH_INFO: `/v3/projects/0a4c83f6f6d34306ac6813bfb90e9222` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.003085 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4c83f6f6d34306ac6813bfb90e9222)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.010815 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.082224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4c83f6f6d34306ac6813bfb90e9222', 'request_id': 'req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:09.089191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4c83f6f6d34306ac6813bfb90e9222', 'request_id': 'req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:09.090630 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:09.097507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4c83f6f6d34306ac6813bfb90e9222', 'request_id': 'req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:09.112632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] The token cache is being invalidate because project 0a4c83f6f6d34306ac6813bfb90e9222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:59:09.112979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:09.113673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-bbd0a5c9-b1fc-49ed-82c8-fa01c6dae65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:09.115322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1342/2684] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:59:08 2022] DELETE /identity/v3/projects/0a4c83f6f6d34306ac6813bfb90e9222 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:09.123073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.124633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.125006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.145944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:09.147344 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:09.179972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:09.215928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1343/2685] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:09.225289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.225561 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.225857 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.244756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:09.246146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:09.254488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1343/2686] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:59:09.259205 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.270306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049910c-1333-421a-b0fa-852b1a6dfe82 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.275109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.275809 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.276417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.276417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.278222 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:59:09.278627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.280470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.293993 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1344/2687] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:59:09.298652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.308569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eaf89-adb7-44cd-b57b-eab73c3d057f None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.314225 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.315009 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.315395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.315770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.316729 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.318846 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.349424 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1344/2688] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:09 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:09.350574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.363371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5bf0a-f9cf-427f-ae9b-5d1c8d2b715a admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.421174 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.421819 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.422129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.422400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.423129 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.425082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.447300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1345/2689] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:09 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:59:09.452258 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.463220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559b25a-421c-460d-94bc-78db68300ba6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.468583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.469290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.469675 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.469956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.470709 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.472343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.484944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1345/2690] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:09.489357 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.500881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e938df-f461-4ea4-82bd-2cfb516413d2 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.505662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.506668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.506958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.507225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.507953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.509607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908166d0-d8f5-4598-813f-2bf551f030ff admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.520133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1346/2691] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:09.524494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.535622 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8e90e-e494-4f22-b592-44f871baf3fd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.541128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.542032 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.542344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.542740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] PATH_INFO: `/v3/projects/f0a650619a4848dc80d6d27bab8d9f4e/users/299ae5fce2af4973890388af0fde9b7b/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.559426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a650619a4848dc80d6d27bab8d9f4e, user_id=299ae5fce2af4973890388af0fde9b7b, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.562483 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.576808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1346/2692] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:09 2022] PUT /identity/v3/projects/f0a650619a4848dc80d6d27bab8d9f4e/users/299ae5fce2af4973890388af0fde9b7b/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:09.587434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.587771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.588055 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.615096 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] MFA Rules not processed for user `299ae5fce2af4973890388af0fde9b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:09.616229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:09.682108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1347/2693] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:09.694319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:09.696416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:09.753724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a59a6f-e2b6-4d43-987c-cd50c5d6db34 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:09.758448 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:09.759094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:09.759370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:09.759636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:09.768975 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:09.770421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8616f2-8ad3-4d18-b344-891259654aff service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:09.779735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1347/2694] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:19.679143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:19.775969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:DELETE=3,keystone:SELECT=57,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:27.527574 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:27.597111 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2d45b-674f-434c-8a7f-610ff813bc9f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:27.601814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:27.602757 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:27.603110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:27.603447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] PATH_INFO: `/v3/users/299ae5fce2af4973890388af0fde9b7b` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:27.604740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299ae5fce2af4973890388af0fde9b7b)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:27.606788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:27.669259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299ae5fce2af4973890388af0fde9b7b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:27.669259 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299ae5fce2af4973890388af0fde9b7b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:27.675362 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299ae5fce2af4973890388af0fde9b7b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:27.688789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299ae5fce2af4973890388af0fde9b7b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:27.689546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299ae5fce2af4973890388af0fde9b7b'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:27.703625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1348/2695] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:59:27 2022] DELETE /identity/v3/users/299ae5fce2af4973890388af0fde9b7b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:27.708263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:27.708773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:27.708873 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:27.731778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:27.732984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:27.798342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1348/2696] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:27.808517 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:27.810928 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:27.874013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff47778-b8d1-40fd-9e13-ce71c456bdf1 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:27.878248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:27.878902 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:27.879185 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:27.879462 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:27.891443 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:27.892973 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36145ef7-fdbb-49cb-9733-14b2390ff939 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:27.904066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1349/2697] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:28.421286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.423039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:28.436327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453380e8-a3f6-47cc-bb09-d7e721696c8a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.442464 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.443425 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.443903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.444342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] PATH_INFO: `/v3/projects/f0a650619a4848dc80d6d27bab8d9f4e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.446312 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a650619a4848dc80d6d27bab8d9f4e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.449344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.502753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a650619a4848dc80d6d27bab8d9f4e', 'request_id': 'req-a9a0fd66-287f-4d97-a36a-be0e8872caca'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:28.509180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a650619a4848dc80d6d27bab8d9f4e', 'request_id': 'req-a9a0fd66-287f-4d97-a36a-be0e8872caca'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:28.515302 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a650619a4848dc80d6d27bab8d9f4e', 'request_id': 'req-a9a0fd66-287f-4d97-a36a-be0e8872caca'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:28.531014 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] The token cache is being invalidate because project f0a650619a4848dc80d6d27bab8d9f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:59:28.531309 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:28.531979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a9a0fd66-287f-4d97-a36a-be0e8872caca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:28.533783 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1349/2698] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:59:28 2022] DELETE /identity/v3/projects/f0a650619a4848dc80d6d27bab8d9f4e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:28.539175 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.539668 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.539778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.559165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:28.560841 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:28.584936 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:28.636268 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1350/2699] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:28.644462 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.644921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.645367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.666327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:28.667582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:28.678695 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1350/2700] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:28.682971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.693752 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60364e3-3553-4fea-b0c1-62f5d3100bbe None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.698406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.699013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.699294 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.699567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.700369 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:59:28.700673 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.702320 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.715316 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1351/2701] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:59:28.720224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.730377 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca38040-9237-48a9-b74d-d52c8bc779b5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.739799 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.740577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.740951 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.741264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.742075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.744648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.776728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1351/2702] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:28 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 14:59:28.782662 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.792878 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095b20f-fa85-45f7-a3ce-4d61d905dbbf admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.859456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.860242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.860591 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.861110 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.861885 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.864684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.896903 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1352/2703] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:28 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:28.901190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.922197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdc3a2-3660-40bd-8bdc-e39045502137 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.929411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.930109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.930393 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.930715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.931629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.933395 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.953801 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1352/2704] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:28.958093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:28.969382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4b21b-368b-41c9-bd63-732a0e4f904c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:28.975430 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:28.976121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:28.976408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:28.976672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:28.977449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:28.979293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeefb5a-0977-4352-b8c7-5f5be64e3581 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:28.990891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1353/2705] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 14:59:28.995583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:29.013154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ad38-f7c8-4f21-bc5f-77a7ffbb373d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:29.021689 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:29.022640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:29.022920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:29.023192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] PATH_INFO: `/v3/projects/7c552a1581a24af68d15de18b9b110b0/users/bda1b22c1bf9413ca9cbf4d49ca0ba17/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:29.043196 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c552a1581a24af68d15de18b9b110b0, user_id=bda1b22c1bf9413ca9cbf4d49ca0ba17, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:29.046770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:29.064479 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1353/2706] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:28 2022] PUT /identity/v3/projects/7c552a1581a24af68d15de18b9b110b0/users/bda1b22c1bf9413ca9cbf4d49ca0ba17/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:29.076872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1c5f-aa42-4ed0-9236-f73dd7de452c None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:29.076872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1c5f-aa42-4ed0-9236-f73dd7de452c None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:29.077284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f1c5f-aa42-4ed0-9236-f73dd7de452c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:29.119312 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-513f1c5f-aa42-4ed0-9236-f73dd7de452c None None] MFA Rules not processed for user `bda1b22c1bf9413ca9cbf4d49ca0ba17`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:29.120641 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-513f1c5f-aa42-4ed0-9236-f73dd7de452c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:29.206043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1354/2707] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:29.217753 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:29.219505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:29.255093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:29.294020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8edb-1af1-4d14-927c-2664084f3c5e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:29.298084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:29.298740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:29.299025 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:29.299303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:29.308408 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:29.310361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfcacb-42fe-4e6e-89d0-6d3888fae77e service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:29.320331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1354/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:29.829894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:29.830405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:29.830516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:29.850618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] MFA Rules not processed for user `3876008710b8469c9f65a24789a58067`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:29.851881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:29.865600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:29.917943 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1355/2709] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:30.724964 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1945-b645-4d67-a7d1-631b984df825 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:30.725532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1945-b645-4d67-a7d1-631b984df825 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:30.725532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1945-b645-4d67-a7d1-631b984df825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:30.744969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-99fd1945-b645-4d67-a7d1-631b984df825 None None] MFA Rules not processed for user `bda1b22c1bf9413ca9cbf4d49ca0ba17`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:30.746340 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-99fd1945-b645-4d67-a7d1-631b984df825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:30.758626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1355/2710] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:34.608494 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:34.614393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:34.712150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f84e4-28fd-4c3b-931f-e9a987a6fe53 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:34.718277 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:34.719036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:34.719390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:34.719761 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:34.721714 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:34.736056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:34.737813 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:34.750201 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1356/2711] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:40.739716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=20 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:44.744680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=51 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:46.132027 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb178-85f9-4504-bc4f-19b32e698487 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:46.132580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb178-85f9-4504-bc4f-19b32e698487 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:46.132959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfb178-85f9-4504-bc4f-19b32e698487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:46.153097 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1bdfb178-85f9-4504-bc4f-19b32e698487 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:46.154969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1bdfb178-85f9-4504-bc4f-19b32e698487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:46.227263 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1356/2712] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:59:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:46.262745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:46.264900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:46.385554 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb30c9-63c6-4b1e-8b52-903567c92256 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:46.395677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:46.396563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:46.396971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:46.397308 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:46.407782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:46.409691 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:46.419547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1357/2713] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:59:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 14:59:47.017101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e26dd-ef5d-40cc-8194-07c7d8043423 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.017407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e26dd-ef5d-40cc-8194-07c7d8043423 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.017685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e26dd-ef5d-40cc-8194-07c7d8043423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.046866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a35e26dd-ef5d-40cc-8194-07c7d8043423 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:47.048286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a35e26dd-ef5d-40cc-8194-07c7d8043423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:47.057574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1357/2714] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:47.071121 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:47.083214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604957a-7a4d-4415-8b84-3b663eae3da7 service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:47.089563 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:47.090282 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.090561 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.090835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.100052 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:47.101701 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:47.111661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1358/2715] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:59:47.350095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c907e-0bbd-4eea-94aa-97bcacfe27a9 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.350588 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c907e-0bbd-4eea-94aa-97bcacfe27a9 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.350756 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c907e-0bbd-4eea-94aa-97bcacfe27a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.369707 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-628c907e-0bbd-4eea-94aa-97bcacfe27a9 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:47.371069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-628c907e-0bbd-4eea-94aa-97bcacfe27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:47.378543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1358/2716] 10.222.0.23 () {58 vars in 1009 bytes} [Mon Jun 20 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:47.390650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:47.401246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077fbb-c494-4df8-8d70-8e2146eeebef service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:47.407068 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:47.407676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.408139 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.408417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.419193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:47.421001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:47.429706 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1359/2717] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 20 14:59:47.820502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.821067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.821545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.844866 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] MFA Rules not processed for user `d833fa0454b14478b733e0e21e559b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:47.846551 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:47.856876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1359/2718] 10.222.0.23 () {58 vars in 967 bytes} [Mon Jun 20 14:59:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:47.869195 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:47.882879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de90a8-3a62-4e32-8015-b9d15c0e0995 service swift] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:47.889218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b96d8006e32d48379aba33d842b0f000', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:47.890086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:47.890371 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:47.890650 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:47.901355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:47.903292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29827af3-946d-46d9-8e3d-a8cfc9e863f8 service swift] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:47.925941 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1360/2719] 10.222.0.23 () {60 vars in 1384 bytes} [Mon Jun 20 14:59:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 20 14:59:50.116386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:50.192299 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f86d9-b2e1-4991-b233-f13d3fba1ba7 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:50.198086 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:50.198959 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.199238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.199480 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] PATH_INFO: `/v3/users/bda1b22c1bf9413ca9cbf4d49ca0ba17` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.200827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bda1b22c1bf9413ca9cbf4d49ca0ba17)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:50.202774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:50.258761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bda1b22c1bf9413ca9cbf4d49ca0ba17'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.259435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bda1b22c1bf9413ca9cbf4d49ca0ba17'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.260033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bda1b22c1bf9413ca9cbf4d49ca0ba17'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.268389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bda1b22c1bf9413ca9cbf4d49ca0ba17'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.282513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bda1b22c1bf9413ca9cbf4d49ca0ba17'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.296810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1360/2720] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:59:50 2022] DELETE /identity/v3/users/bda1b22c1bf9413ca9cbf4d49ca0ba17 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:50.301135 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.301965 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.302238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.320322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:50.321570 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:50.382918 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1361/2721] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:50.392735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:50.394778 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:50.402826 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:50.483285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c83b09-e69a-4872-90ec-3728b878603e admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:50.487113 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:50.487768 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.488051 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.488326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.500289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:50.500289 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:50.510244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1361/2722] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:50.510392 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:50.519911 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d815b-bac2-4186-bc55-b20870e5a7e2 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:50.523908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:50.524588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.524888 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.525160 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.526979 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:50.545737 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:50.547196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e1afc-c8bc-4890-a792-64721af9e14a service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:50.557774 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1362/2723] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 14:59:50.832404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:50.834384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:50.848553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32930e-5b15-4b31-a8e0-682bee6aaa60 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:50.853376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:50.854447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.854725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.855021 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] PATH_INFO: `/v3/projects/7c552a1581a24af68d15de18b9b110b0` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.856365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c552a1581a24af68d15de18b9b110b0)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:50.859190 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:50.916133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c552a1581a24af68d15de18b9b110b0', 'request_id': 'req-3ffd84aa-6d65-4156-86d1-a743c2e34d81'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.923366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c552a1581a24af68d15de18b9b110b0', 'request_id': 'req-3ffd84aa-6d65-4156-86d1-a743c2e34d81'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.929563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c552a1581a24af68d15de18b9b110b0', 'request_id': 'req-3ffd84aa-6d65-4156-86d1-a743c2e34d81'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.944038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] The token cache is being invalidate because project 7c552a1581a24af68d15de18b9b110b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:59:50.944326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.944968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-3ffd84aa-6d65-4156-86d1-a743c2e34d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:50.946643 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1362/2724] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:59:50 2022] DELETE /identity/v3/projects/7c552a1581a24af68d15de18b9b110b0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:50.951874 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:50.952208 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:50.952500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:50.971387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:50.972628 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:51.010798 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:51.040194 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1363/2725] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:59:51.048067 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.048441 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.048819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.068127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:51.069488 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:51.078376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1363/2726] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:51.082645 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.092950 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ae3ae-c168-49fd-9a74-438abeacd249 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.097799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.098460 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.098740 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.099012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.099739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:59:51.100044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.101958 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.118196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1364/2727] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 14:59:51.119482 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.129290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f5952-f2a3-4521-baa3-732c770572f5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.134156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.134809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.135090 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.135363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.136054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.138267 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.171980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1364/2728] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:51 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:51.173387 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.183372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f485c3-02e2-4b2d-91c3-7e88f566554b admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.243790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.244473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.244802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.245058 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.245766 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.247746 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.270251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1365/2729] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:51 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:51.274583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.285887 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125589f-8bce-45f5-81af-a7b3355e04e1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.290692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.291342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.291640 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.291911 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.292621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.294360 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.305261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1365/2730] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:51.309152 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.320604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6d71d-5b2b-4684-b9cb-35e8c3fc69e0 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.325963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.326627 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.326910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.327181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.327907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.329546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a376c2-6d63-4176-b56f-d17b643559ad admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.339723 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1366/2731] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:51.344011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.354571 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3561-d984-4411-9a5e-7a3d1e040065 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.359357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.360243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.360519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.360822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] PATH_INFO: `/v3/projects/f29cab4870474548b98c3a81a3aa8031/users/5422c53c285f4e33998f7aabe528750c/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.375962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29cab4870474548b98c3a81a3aa8031, user_id=5422c53c285f4e33998f7aabe528750c, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.378854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.393590 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1366/2732] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:51 2022] PUT /identity/v3/projects/f29cab4870474548b98c3a81a3aa8031/users/5422c53c285f4e33998f7aabe528750c/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 14:59:51.398829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.399172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.399635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.420949 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:51.422188 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:51.483734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1367/2733] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 14:59:51.494662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:51.496980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:51.534519 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:51.572872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f42174-9241-48dd-afd2-257e540288da admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:51.576724 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:51.577405 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:51.577685 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:51.577958 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:51.589127 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:51.590688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:51.602215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1367/2734] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:54.215967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:54.218845 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:54.235317 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cc261-0512-4f31-a4d1-5a3738fb646a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:54.249212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:54.250576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:54.251030 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:54.251449 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] PATH_INFO: `/v3/users/69c4f81285904da78e96a4a515ec2cb2` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:54.253592 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c4f81285904da78e96a4a515ec2cb2)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:54.257138 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:54.334782 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:54.346974 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c4f81285904da78e96a4a515ec2cb2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.348004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c4f81285904da78e96a4a515ec2cb2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.364674 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c4f81285904da78e96a4a515ec2cb2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.382609 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c4f81285904da78e96a4a515ec2cb2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.383477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-4cb0c8ad-1846-476c-a5e5-5fadcbce7c31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c4f81285904da78e96a4a515ec2cb2'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.399313 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1368/2735] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 14:59:54 2022] DELETE /identity/v3/users/69c4f81285904da78e96a4a515ec2cb2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:54.610832 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:54.621530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b144-9177-4dc9-bc3b-52d46efd3cc2 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:54.694022 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:54.695315 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:54.695600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:54.696411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] PATH_INFO: `/v3/projects/a98f7478c9384ee298321a1506aa0bde` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:54.698063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98f7478c9384ee298321a1506aa0bde)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:54.701064 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:54.756128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98f7478c9384ee298321a1506aa0bde', 'request_id': 'req-78be0cbb-3983-4769-bd4d-55abec8c0fd3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.763563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98f7478c9384ee298321a1506aa0bde', 'request_id': 'req-78be0cbb-3983-4769-bd4d-55abec8c0fd3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.771089 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98f7478c9384ee298321a1506aa0bde', 'request_id': 'req-78be0cbb-3983-4769-bd4d-55abec8c0fd3'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.795850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] The token cache is being invalidate because project a98f7478c9384ee298321a1506aa0bde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 14:59:54.796474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.797274 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-78be0cbb-3983-4769-bd4d-55abec8c0fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 14:59:54.799297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1368/2736] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 14:59:54 2022] DELETE /identity/v3/projects/a98f7478c9384ee298321a1506aa0bde => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:54.804315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:54.804624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:54.805066 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:54.836524 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:54.838265 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:54.970684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1369/2737] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:54.979874 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:54.980184 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:54.980487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.015411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:55.016814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:55.037250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1369/2738] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:55.038292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.053629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd840c60-052c-482c-b223-69bc16821ea6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.065686 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.066403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.066689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.066960 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.067710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 14:59:55.068017 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.070141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.089243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1370/2739] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 20 14:59:55.093094 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.103543 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0341-3f21-488b-a5d4-203259cc94c5 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.108700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.109414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.109698 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.109970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.110670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.112597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.146328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1370/2740] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:55 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:55.148322 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.159224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c91-a34d-49ee-8767-5facbf26ce20 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.226994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.227967 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.228485 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.229004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.229930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.232445 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.260137 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1371/2741] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:55 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:55.261593 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.273273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdb797-32e5-4914-8384-afc34d2c304a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.278718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.279435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.279835 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.280168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.281511 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.283039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.298736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1371/2742] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:55.300601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.312881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39793-96cc-4ea8-a234-dd3b7e94572c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.318531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.319290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.319639 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.319998 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.320840 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.322719 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6b415-0baf-47a0-811c-a80b84723b6d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.335024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1372/2743] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:55.339569 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.354036 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d2ba8-d513-4b84-b2c1-b15a199d53ee admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.361812 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.362774 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.363226 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.363506 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] PATH_INFO: `/v3/projects/d70851020f444aeeaa7a5cb23615719f/users/5a547b71ff3848ea97f77c9664a7068e/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.384998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70851020f444aeeaa7a5cb23615719f, user_id=5a547b71ff3848ea97f77c9664a7068e, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.388110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.393275 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:55.413851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1372/2744] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:55 2022] PUT /identity/v3/projects/d70851020f444aeeaa7a5cb23615719f/users/5a547b71ff3848ea97f77c9664a7068e/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:55.418952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaabd8-b3a9-48b8-8f3c-35b1b35a9ac4 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.419408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaabd8-b3a9-48b8-8f3c-35b1b35a9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.420870 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaabd8-b3a9-48b8-8f3c-35b1b35a9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.447070 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-addaabd8-b3a9-48b8-8f3c-35b1b35a9ac4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:55.449237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-addaabd8-b3a9-48b8-8f3c-35b1b35a9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:55.472771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 14:59:55.527833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1373/2745] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:55.538856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:55.541176 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:55.619875 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67df10-7839-49b8-8503-465ae2079b8c admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:55.626156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:55.626892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:55.627173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:55.627746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:55.640416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:55.642853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:55.657998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1373/2746] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 14:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 14:59:56.287747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.288604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.289087 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.318083 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] MFA Rules not processed for user `5422c53c285f4e33998f7aabe528750c`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 14:59:56.319321 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:56.391961 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1374/2747] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 14:59:56.396436 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.398001 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 14:59:56.414270 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31815efc-6c1f-46ff-a72d-067dcb4a8461 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.422607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.423382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.424406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.424406 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.424926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.427154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.464427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1374/2748] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 14:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:56.468695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.481301 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda9d5c-422e-4224-8d3b-ff3419887572 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.552789 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.553748 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.554186 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.554614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.555611 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.557934 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.591196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1375/2749] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 14:59:56 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 14:59:56.592528 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.606019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee48b76-f2c7-47fa-9c9f-bdfa0bb2f9a0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.611220 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.612075 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.612358 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.612629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.613566 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.615296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.633862 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1375/2750] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:56.638001 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.654366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9b010-72c4-4977-af8b-e58b503f5514 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.663071 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.663975 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.664253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.664578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] PATH_INFO: `/v3/projects/117ab1f62f4140a0b929db4827cc009f/users/0c6abb4bbf364c85844e543209c048ad/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.688894 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] RBAC: Authorizing `identity:create_grant(project_id=117ab1f62f4140a0b929db4827cc009f, user_id=0c6abb4bbf364c85844e543209c048ad, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.696023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.720015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1376/2751] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:56 2022] PUT /identity/v3/projects/117ab1f62f4140a0b929db4827cc009f/users/0c6abb4bbf364c85844e543209c048ad/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 14:59:56.724576 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.738469 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31f840-fcec-4f35-a667-52e2873ec371 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.823601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.824904 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.826046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.826535 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.827459 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.829328 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c511f-44fd-464d-9861-3bd56ae1b383 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.846070 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1376/2752] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 14:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 14:59:56.847350 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 14:59:56.886741 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c4f6e-8328-43a8-8fb7-a1da7b1b883c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 14:59:56.894734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 14:59:56.895868 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 14:59:56.897122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 14:59:56.897400 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] PATH_INFO: `/v3/projects/117ab1f62f4140a0b929db4827cc009f/users/0c6abb4bbf364c85844e543209c048ad/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 14:59:56.899970 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=117ab1f62f4140a0b929db4827cc009f, user_id=0c6abb4bbf364c85844e543209c048ad, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 14:59:56.903136 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 14:59:56.915134 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1377/2753] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 14:59:56 2022] PUT /identity/v3/projects/117ab1f62f4140a0b929db4827cc009f/users/0c6abb4bbf364c85844e543209c048ad/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:00:01.381010 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea767f6-0d6e-43b7-aa34-b2cb38cfcf50 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:01.381802 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea767f6-0d6e-43b7-aa34-b2cb38cfcf50 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:01.382266 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea767f6-0d6e-43b7-aa34-b2cb38cfcf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:01.434870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-3ea767f6-0d6e-43b7-aa34-b2cb38cfcf50 None None] MFA Rules not processed for user `5a547b71ff3848ea97f77c9664a7068e`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:00:01.436255 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3ea767f6-0d6e-43b7-aa34-b2cb38cfcf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:01.523884 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:01.552829 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1377/2754] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:00:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:00:01.572571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:00:01.574869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:01.582848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:01.760360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa174290-8cc8-4e07-87ef-9f716ed5d4cb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:00:01.783860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:00:01.784588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:01.785006 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:01.785289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:01.807613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:00:01.811569 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:00:01.854865 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1378/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:00:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:00:03.547735 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fb7b-fd68-43fd-a125-4287cd4bd4ac None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:03.548651 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fb7b-fd68-43fd-a125-4287cd4bd4ac None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:03.548977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fb7b-fd68-43fd-a125-4287cd4bd4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:03.580375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f1d5fb7b-fd68-43fd-a125-4287cd4bd4ac None None] MFA Rules not processed for user `0c6abb4bbf364c85844e543209c048ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:00:03.584241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f1d5fb7b-fd68-43fd-a125-4287cd4bd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:03.717816 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1378/2756] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:00:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:00:03.734558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:00:03.736546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:03.763664 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53c795-8a62-43d2-839f-c5dacd0cd18e service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:00:03.782616 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:00:03.783817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:03.784315 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:03.784583 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:03.888593 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:00:03.890073 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:00:03.910353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1379/2757] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:00:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:00:04.086142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb8e5-9f25-4f5a-807a-b455c1c6fc4e None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:04.086730 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb8e5-9f25-4f5a-807a-b455c1c6fc4e None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:04.087108 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2bb8e5-9f25-4f5a-807a-b455c1c6fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:04.108662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7d2bb8e5-9f25-4f5a-807a-b455c1c6fc4e None None] MFA Rules not processed for user `5a547b71ff3848ea97f77c9664a7068e`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:00:04.111123 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7d2bb8e5-9f25-4f5a-807a-b455c1c6fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:04.120893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1379/2758] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:00:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:00:04.862470 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:00:04.864150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:04.948232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6f864-a110-454b-a538-87a3cad79325 service nova] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:00:04.952780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:00:04.955713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:04.956079 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:04.956426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:04.958422 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:04.969854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:00:04.971708 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:00:04.983890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1380/2759] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:00:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:00:05.770122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:05.770662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:05.770662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:05.789552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] MFA Rules not processed for user `5422c53c285f4e33998f7aabe528750c`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:00:05.790759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:05.798507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1380/2760] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:00:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:00:10.603408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:00:10.605167 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:10.647736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:10.693712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be90190-a4f4-4390-b04b-dbdaa86fc2e2 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:00:10.699074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:00:10.699777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:10.700056 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:10.700331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:10.702189 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:00:10.715246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:00:10.716900 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fc5b1-d209-460a-87c8-da7c8d1f9104 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:00:10.727292 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1381/2761] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:00:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:00:15.784052 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=44 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:20.723040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=18 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:00:37.922062 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:00:37.931957 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafe314-09ca-4d80-af34-15402099c8ef None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:00:37.936038 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:00:37.936696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:00:37.936979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:00:37.937272 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:00:37.946508 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:00:37.947919 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:00:37.958002 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1381/2762] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:00:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:00:47.953487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:01:25.250025 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:01:25.250614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:01:25.250614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:01:25.269567 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] MFA Rules not processed for user `3876008710b8469c9f65a24789a58067`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:01:25.270758 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:01:25.332710 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1382/2763] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:01:35.321539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=25 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:03.676105 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:02:03.688435 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f5bf-c4e5-49f8-80f4-7ee09ee56e8e service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:02:03.694256 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:02:03.694977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:03.695262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:03.695582 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:03.697658 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:03.713233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:02:03.714740 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:02:03.727146 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1382/2764] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:02:04.920143 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:02:04.935038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cbf2f-6524-42bc-8881-8867d603e8c5 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:02:04.939895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:02:04.940572 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:04.940881 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:04.941155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:04.943293 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:04.960323 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:02:04.961963 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefa1d1-0d21-49a0-b464-69ffd1968b17 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:02:04.974284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1383/2765] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:02:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:02:13.721467 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:14.968767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=6 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:02:47.629553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:02:47.642260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67d38f-88b9-41e5-832c-67e653e322b9 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:02:47.646968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:02:47.647211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:47.647427 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:47.647704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:47.649736 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:47.660825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:02:47.662260 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:02:47.671536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1383/2766] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:02:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:02:49.427426 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:49.427995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:49.427995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:49.449297 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] MFA Rules not processed for user `5a547b71ff3848ea97f77c9664a7068e`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:02:49.450530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:49.458634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1384/2767] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:02:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:02:50.935940 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:02:50.946313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5b6d04-868c-4645-972a-c4e8715d06ae service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:02:50.952690 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:02:50.953379 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:50.953660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:50.953926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:50.955900 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:50.967792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:02:50.969558 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:02:50.979530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1384/2768] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:02:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:02:51.107454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:02:51.122867 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6eca3-6ec9-4b4b-bfc6-787699d1a535 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:02:51.128667 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:02:51.129971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:02:51.135577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:02:51.136421 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:02:51.143015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:02:51.166214 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:02:51.168165 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:02:51.180848 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1385/2769] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:02:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:03:00.974938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=12 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:01.174889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=9 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:12.578763 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:12.590515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7c705-d121-4ea3-b77b-653bae68110a service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:12.595222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:12.595864 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:12.596174 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:12.596444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:12.598583 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:12.610855 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:12.612306 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:12.622193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1385/2770] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:03:22.617493 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:26.073769 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:26.082734 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0603e-5f5e-4ab0-b95d-b57fadd5c647 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:26.086393 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:26.087032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:26.087309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:26.087578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:26.089396 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:26.161291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:26.162717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:26.173273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1386/2771] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:03:29.298391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:29.310944 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f0d3d-712d-444e-b1c1-117af8315545 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:29.316591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:29.317487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:29.317920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:29.318290 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:29.320249 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:29.334489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:29.336223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:29.352892 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1386/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:03:32.559035 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:32.560743 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:32.573794 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e585a-e765-4222-9528-69be52bbff2e service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:32.579163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:32.580082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:32.580361 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:32.580632 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] PATH_INFO: `/v3/users/3876008710b8469c9f65a24789a58067` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:32.581956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3876008710b8469c9f65a24789a58067)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:32.583924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:32.634873 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3876008710b8469c9f65a24789a58067'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:32.635635 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3876008710b8469c9f65a24789a58067'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:32.648488 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3876008710b8469c9f65a24789a58067'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:32.658374 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3876008710b8469c9f65a24789a58067'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:32.659310 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3876008710b8469c9f65a24789a58067'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:32.680395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1387/2773] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:03:32 2022] DELETE /identity/v3/users/3876008710b8469c9f65a24789a58067 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:03:32.886456 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:32.897941 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d705fd-01c1-4b93-878e-fb61b4dec2e0 service placement] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:32.955997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:32.956822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:32.957115 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:32.957367 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] PATH_INFO: `/v3/projects/c4515b09c1944036b62a40cc5e88719e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:32.958563 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4515b09c1944036b62a40cc5e88719e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:32.960523 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:33.009335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4515b09c1944036b62a40cc5e88719e', 'request_id': 'req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.016055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4515b09c1944036b62a40cc5e88719e', 'request_id': 'req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.022664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4515b09c1944036b62a40cc5e88719e', 'request_id': 'req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.037822 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] The token cache is being invalidate because project c4515b09c1944036b62a40cc5e88719e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:03:33.038142 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.038748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.040345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1387/2774] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:03:32 2022] DELETE /identity/v3/projects/c4515b09c1944036b62a40cc5e88719e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:03:33.044656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:33.046172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:33.059896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2540a-6d0c-4ee6-b254-1b19ae97ed4f admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:33.124638 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:33.125956 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:33.126299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:33.126640 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] PATH_INFO: `/v3/users/f4a86fe83ee24291b74549ccbc0a2774` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:33.128684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a86fe83ee24291b74549ccbc0a2774)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:33.131915 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:33.138938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:33.185109 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a86fe83ee24291b74549ccbc0a2774'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.185895 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a86fe83ee24291b74549ccbc0a2774'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.199042 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a86fe83ee24291b74549ccbc0a2774'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.208215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a86fe83ee24291b74549ccbc0a2774'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.208799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a86fe83ee24291b74549ccbc0a2774'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.221747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1388/2775] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:03:33 2022] DELETE /identity/v3/users/f4a86fe83ee24291b74549ccbc0a2774 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:03:33.397853 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:03:33.399346 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:03:33.413372 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7592b-ea95-423c-b39c-7dfd27aa2b00 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:03:33.474375 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:03:33.475166 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:03:33.475447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:03:33.475718 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] PATH_INFO: `/v3/projects/4b42cc6a785a4ad4bc47c68380465045` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:03:33.476968 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b42cc6a785a4ad4bc47c68380465045)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:03:33.479015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:03:33.499965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:33.529154 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b42cc6a785a4ad4bc47c68380465045', 'request_id': 'req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.535714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b42cc6a785a4ad4bc47c68380465045', 'request_id': 'req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.541764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b42cc6a785a4ad4bc47c68380465045', 'request_id': 'req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.555432 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] The token cache is being invalidate because project 4b42cc6a785a4ad4bc47c68380465045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:03:33.555719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.556398 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:03:33.558627 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1388/2776] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:03:33 2022] DELETE /identity/v3/projects/4b42cc6a785a4ad4bc47c68380465045 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:03:43.218456 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:03:43.552345 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:10.467872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:10.469472 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:10.548819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:10.550296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:10.566217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85637490-3aa0-4fbf-814c-9a692556f053 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:10.622133 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae0b9ca-e34b-4043-9d10-1f4ed93fb13b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:10.626982 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:10.627869 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:10.628150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:10.628430 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] PATH_INFO: `/v3/users/5a547b71ff3848ea97f77c9664a7068e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:10.629097 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:10.629664 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a547b71ff3848ea97f77c9664a7068e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:10.629807 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:10.630059 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:10.630334 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:10.631600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:10.632093 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:10.643982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:10.645618 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:10.656172 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1389/2777] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:10.689686 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a547b71ff3848ea97f77c9664a7068e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:10.690418 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a547b71ff3848ea97f77c9664a7068e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:10.691361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a547b71ff3848ea97f77c9664a7068e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:10.700221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a547b71ff3848ea97f77c9664a7068e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:10.713687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-7c21a0f1-9d86-45b4-b841-28c6e4d52903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a547b71ff3848ea97f77c9664a7068e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:10.727107 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1389/2778] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:10 2022] DELETE /identity/v3/users/5a547b71ff3848ea97f77c9664a7068e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:10.920908 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:10.932375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a70c5d-a627-41b2-858e-2273827fe57b service placement] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:10.997283 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:10.998120 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:10.998435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:10.998712 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] PATH_INFO: `/v3/projects/d70851020f444aeeaa7a5cb23615719f` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.000044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70851020f444aeeaa7a5cb23615719f)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.002019 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.043376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:11.053007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70851020f444aeeaa7a5cb23615719f', 'request_id': 'req-ad806f07-a2c0-4bc0-9397-26362a8cc669'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:11.059839 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70851020f444aeeaa7a5cb23615719f', 'request_id': 'req-ad806f07-a2c0-4bc0-9397-26362a8cc669'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:11.065226 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70851020f444aeeaa7a5cb23615719f', 'request_id': 'req-ad806f07-a2c0-4bc0-9397-26362a8cc669'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:11.080999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] The token cache is being invalidate because project d70851020f444aeeaa7a5cb23615719f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:11.081299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:11.081916 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-ad806f07-a2c0-4bc0-9397-26362a8cc669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:11.083486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1390/2779] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:10 2022] DELETE /identity/v3/projects/d70851020f444aeeaa7a5cb23615719f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:11.088404 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.088856 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.089716 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.108626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:11.109867 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:11.173338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1390/2780] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:11.182605 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.182893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.183408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.204163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:11.205408 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:11.216057 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1391/2781] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:11.220512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.230520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f65299-b6b0-4ccd-870e-b3462221d0b3 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.236407 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.237110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.237517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.237796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] PATH_INFO: `/v3/domains` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.238559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 15:04:11.238865 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.240494 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.254218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1391/2782] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 15:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 15:04:11.259215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.274183 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4c1e6-098f-4bda-b2bb-58c7a9b4286f None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.281095 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.281750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.282031 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.282299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.282991 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.284942 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.314534 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1392/2783] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:11.318920 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.329303 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aac938-3b2b-48dc-83a6-c1e30498171d admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.333388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:11.390048 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.390722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.391005 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.391284 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.391971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.393945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.415043 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1392/2784] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:11.419925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.435981 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0298531-8a77-4ff8-8fea-2da7136b36aa admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.441081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.441744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.442027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.442309 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.443041 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.444651 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.456518 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1393/2785] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:11.461507 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.477795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b4f5-c531-45ad-8f96-f1f1191b5ac7 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.484676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.485376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.485657 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.485929 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.486660 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.488304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797fd11-9aeb-4b85-9535-584f8e2dda02 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.504079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1393/2786] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:11.509248 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.520224 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d2a44-6c48-4150-b083-522276813278 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.525342 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.526269 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.526556 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.526835 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] PATH_INFO: `/v3/projects/c182d9aae12941bd99a51c28cbc33489/users/271b7741f30e4df99698a2ff1855f8f6/roles/75014435b442408ea67a373f2483e12c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.543823 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c182d9aae12941bd99a51c28cbc33489, user_id=271b7741f30e4df99698a2ff1855f8f6, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.546614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.561697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1394/2787] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:11 2022] PUT /identity/v3/projects/c182d9aae12941bd99a51c28cbc33489/users/271b7741f30e4df99698a2ff1855f8f6/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:11.572193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.572708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.572837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.599568 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] MFA Rules not processed for user `271b7741f30e4df99698a2ff1855f8f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:11.600883 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:11.665624 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1394/2788] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:11.670625 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.735478 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ada8-c35e-4539-8ffb-8d16e7c4f3e0 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.740971 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.741619 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.741892 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.742164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] PATH_INFO: `/v3/projects` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.742862 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.744759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.771481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1395/2789] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 15:04:11.775577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.786645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447208d-ec38-4a05-97f8-7f3d1d81a3b6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.845390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.846059 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.846348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.846621 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] PATH_INFO: `/v3/users` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.847326 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.849307 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.871655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1395/2790] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:11 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 15:04:11.876092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.886767 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08662b8-dd6a-4418-ba4a-4a546884914c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.891575 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.892236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.892516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.892825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.893626 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.895333 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.906474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1396/2791] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:11.910703 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.917414 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:11.921575 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f480b-5c5e-4b24-85cb-8b228147d568 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:11.927502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:11.928370 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:11.928653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:11.928962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] PATH_INFO: `/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3/users/c45ec6a3a1e5472a8eacb6669f858dda/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:11.944366 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=717cd0755f3b4a14a9aab9a0d326ece3, user_id=c45ec6a3a1e5472a8eacb6669f858dda, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:11.947056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:11.961872 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1396/2792] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:11 2022] PUT /identity/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3/users/c45ec6a3a1e5472a8eacb6669f858dda/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:11.966217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:11.976434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d933d-4eb9-48ed-b91b-c060ff348a63 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:12.008223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:12.039655 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:12.040389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:12.040666 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:12.040966 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:12.041694 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:12.043406 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb498b5-db8f-4c85-ade9-66e7c7f3a6cf admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:12.053273 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1397/2793] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:12.057870 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:12.068348 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2d09d-0c53-4346-b3a6-9d679055b5fc admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:12.073297 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:12.074222 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:12.074503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:12.074773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] PATH_INFO: `/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3/users/c45ec6a3a1e5472a8eacb6669f858dda/roles/695e03655fc54138a800137878e15659` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:12.076930 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=717cd0755f3b4a14a9aab9a0d326ece3, user_id=c45ec6a3a1e5472a8eacb6669f858dda, role_id=695e03655fc54138a800137878e15659)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:12.079607 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:12.090221 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1397/2794] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:12 2022] PUT /identity/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3/users/c45ec6a3a1e5472a8eacb6669f858dda/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:12.101738 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:12.101954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:12.102215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:12.134045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] MFA Rules not processed for user `c45ec6a3a1e5472a8eacb6669f858dda`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:12.135696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:12.214295 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1398/2795] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 15:04:12.225837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:12.227841 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:12.289530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee30637-b28f-4671-853f-1fdb67da3e8a admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:12.293147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:12.293800 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:12.294078 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:12.294347 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:12.358814 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:12.360305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:12.369719 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1398/2796] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:17.021395 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:17.032930 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c337-a2f3-4c46-8f3a-1f217e8e2ca0 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:17.037085 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:17.037802 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:17.038086 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:17.038355 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:17.048228 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:17.049726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:17.060473 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1399/2797] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:21.437591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:21.440197 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:21.533843 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a7aea-bdbb-49a4-8966-e82e62ecb537 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:21.540662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:21.541148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:21.541442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:21.541788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:21.543586 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:21.557642 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:21.559342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:21.571837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1399/2798] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:27.056389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=54 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:31.566681 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:33.082329 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:33.083889 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:33.155780 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf88552-a3d4-4d6f-a29a-154b6fd2851a service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:33.160227 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:33.161133 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:33.161412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:33.161681 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] PATH_INFO: `/v3/users/5422c53c285f4e33998f7aabe528750c` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:33.162863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5422c53c285f4e33998f7aabe528750c)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:33.164925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:33.222351 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5422c53c285f4e33998f7aabe528750c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.222996 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5422c53c285f4e33998f7aabe528750c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.235539 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5422c53c285f4e33998f7aabe528750c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.245504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5422c53c285f4e33998f7aabe528750c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.246255 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5422c53c285f4e33998f7aabe528750c'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.259760 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1400/2799] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:33 2022] DELETE /identity/v3/users/5422c53c285f4e33998f7aabe528750c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:33.448376 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:33.461604 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce130bd-390b-4bcf-8ef0-f962e84dfd55 service nova] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:33.530910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:33.531891 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:33.532182 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:33.532487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] PATH_INFO: `/v3/projects/f29cab4870474548b98c3a81a3aa8031` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:33.533790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29cab4870474548b98c3a81a3aa8031)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:33.535721 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:33.584019 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29cab4870474548b98c3a81a3aa8031', 'request_id': 'req-5eace95c-cb02-42de-bfcb-4c36c0013910'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.590411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29cab4870474548b98c3a81a3aa8031', 'request_id': 'req-5eace95c-cb02-42de-bfcb-4c36c0013910'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.596192 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29cab4870474548b98c3a81a3aa8031', 'request_id': 'req-5eace95c-cb02-42de-bfcb-4c36c0013910'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.610728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] The token cache is being invalidate because project f29cab4870474548b98c3a81a3aa8031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:33.611013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.611644 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.613229 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1400/2800] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:33 2022] DELETE /identity/v3/projects/f29cab4870474548b98c3a81a3aa8031 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:33.617300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:33.619078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:33.633347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d6b4-12bb-4cea-ac67-aeab5f644008 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:33.701117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:33.702306 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:33.702596 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:33.702872 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] PATH_INFO: `/v3/users/0c6abb4bbf364c85844e543209c048ad` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:33.704654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6abb4bbf364c85844e543209c048ad)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:33.707623 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:33.730562 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:33.758150 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6abb4bbf364c85844e543209c048ad'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.758790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6abb4bbf364c85844e543209c048ad'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.770216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6abb4bbf364c85844e543209c048ad'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.778604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6abb4bbf364c85844e543209c048ad'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.779232 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6abb4bbf364c85844e543209c048ad'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:33.791938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1401/2801] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:33 2022] DELETE /identity/v3/users/0c6abb4bbf364c85844e543209c048ad => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:33.971654 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:33.973175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:33.986591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eace95c-cb02-42de-bfcb-4c36c0013910 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:34.046708 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:34.047503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:34.047781 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:34.048053 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] PATH_INFO: `/v3/projects/117ab1f62f4140a0b929db4827cc009f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:34.049283 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=117ab1f62f4140a0b929db4827cc009f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:34.051218 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:34.087831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:34.101390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117ab1f62f4140a0b929db4827cc009f', 'request_id': 'req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:34.108082 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117ab1f62f4140a0b929db4827cc009f', 'request_id': 'req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:34.114042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117ab1f62f4140a0b929db4827cc009f', 'request_id': 'req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:34.128634 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] The token cache is being invalidate because project 117ab1f62f4140a0b929db4827cc009f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:34.128963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:34.129572 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-b3ef4e8a-47a8-4298-b69f-beb68f3398cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:34.131128 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1401/2802] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:33 2022] DELETE /identity/v3/projects/117ab1f62f4140a0b929db4827cc009f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:38.037812 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:38.039906 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:38.054938 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e45d6-2d20-4d43-b2ca-804ae0944ffd admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:38.111552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:38.112420 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:38.112702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:38.112995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] PATH_INFO: `/v3/users/271b7741f30e4df99698a2ff1855f8f6` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:38.114215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271b7741f30e4df99698a2ff1855f8f6)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:38.116131 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:38.172103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271b7741f30e4df99698a2ff1855f8f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.172778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271b7741f30e4df99698a2ff1855f8f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.186244 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271b7741f30e4df99698a2ff1855f8f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.196252 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271b7741f30e4df99698a2ff1855f8f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.196999 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271b7741f30e4df99698a2ff1855f8f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.209492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1402/2803] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:38 2022] DELETE /identity/v3/users/271b7741f30e4df99698a2ff1855f8f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:38.214248 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:38.214811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:38.214811 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:38.232836 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:38.234420 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:38.294039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1402/2804] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:38.304288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:38.305771 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:38.327327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:38.368116 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c961ec-add2-4eb8-a5fb-b9df5c2e3f01 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:38.372299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:38.372988 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:38.373241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:38.373607 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:38.383486 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:38.384955 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:38.395288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1403/2805] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 20 15:04:38.666343 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:38.667793 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:38.682387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9562bc6-3c67-425f-9ca8-3590814a7d6d None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:38.689288 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:38.690331 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:38.690612 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:38.690882 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] PATH_INFO: `/v3/projects/c182d9aae12941bd99a51c28cbc33489` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:38.692186 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c182d9aae12941bd99a51c28cbc33489)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:38.694159 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:38.743230 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c182d9aae12941bd99a51c28cbc33489', 'request_id': 'req-5b69290e-1196-434b-8594-a714dd5ed049'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.749996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c182d9aae12941bd99a51c28cbc33489', 'request_id': 'req-5b69290e-1196-434b-8594-a714dd5ed049'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.756349 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c182d9aae12941bd99a51c28cbc33489', 'request_id': 'req-5b69290e-1196-434b-8594-a714dd5ed049'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.770921 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] The token cache is being invalidate because project c182d9aae12941bd99a51c28cbc33489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:38.771228 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.771831 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.773388 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1403/2806] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:38 2022] DELETE /identity/v3/projects/c182d9aae12941bd99a51c28cbc33489 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:38.777493 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:38.788348 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa5148-5463-4c1a-840f-63c68a0717a9 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:38.849196 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:38.850102 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:38.850385 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:38.850656 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] PATH_INFO: `/v3/users/c45ec6a3a1e5472a8eacb6669f858dda` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:38.851879 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45ec6a3a1e5472a8eacb6669f858dda)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:38.853891 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:38.903750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45ec6a3a1e5472a8eacb6669f858dda'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.904391 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45ec6a3a1e5472a8eacb6669f858dda'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.917225 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45ec6a3a1e5472a8eacb6669f858dda'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.926713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45ec6a3a1e5472a8eacb6669f858dda'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.927390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-52c7f079-c6af-4ff8-bc13-706181f52f6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45ec6a3a1e5472a8eacb6669f858dda'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:38.940284 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1404/2807] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:38 2022] DELETE /identity/v3/users/c45ec6a3a1e5472a8eacb6669f858dda => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:39.245210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.246722 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:39.261876 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69290e-1196-434b-8594-a714dd5ed049 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.309723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:39.327324 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.328223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.328505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.328773 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] PATH_INFO: `/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.329980 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717cd0755f3b4a14a9aab9a0d326ece3)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.332034 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.387516 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717cd0755f3b4a14a9aab9a0d326ece3', 'request_id': 'req-758990e1-7c7f-4f2a-a893-c0963eb6aa15'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:39.394189 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717cd0755f3b4a14a9aab9a0d326ece3', 'request_id': 'req-758990e1-7c7f-4f2a-a893-c0963eb6aa15'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:39.400210 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717cd0755f3b4a14a9aab9a0d326ece3', 'request_id': 'req-758990e1-7c7f-4f2a-a893-c0963eb6aa15'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:39.414412 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] The token cache is being invalidate because project 717cd0755f3b4a14a9aab9a0d326ece3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:39.414696 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:39.415327 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-758990e1-7c7f-4f2a-a893-c0963eb6aa15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:39.416903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1404/2808] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:39 2022] DELETE /identity/v3/projects/717cd0755f3b4a14a9aab9a0d326ece3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:39.422336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.422833 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.422940 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.442171 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:39.443397 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:39.478715 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:39.509830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1405/2809] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:39.517700 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.517987 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.518261 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.536992 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:39.538242 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:39.546934 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1405/2810] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:39.551854 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.565863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4070b-82de-4c2f-9b62-cbdd10b5b3d6 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.571552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.572210 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.572492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.572796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.573526 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 15:04:39.573830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.575447 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.593450 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1406/2811] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 15:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 15:04:39.598257 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.607775 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baf49f-5559-4d14-b07c-3724734ea57a None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.612903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.613545 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.613827 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.614095 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.614788 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.616693 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.645300 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1406/2812] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 20 15:04:39.649657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.659890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f36ff-60a3-4f36-aeae-a5dd4f41115d admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.719546 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.720215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.720498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.720796 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.721505 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.723438 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.745994 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1407/2813] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:39.751244 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.763777 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1946-1e40-48f4-b198-735573e76f75 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.771505 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.772513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.772962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.773286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.774396 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.776969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.788687 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1407/2814] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:39.792893 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.803463 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5007dc-d241-4527-a626-370f2edb46b6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.808864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.809519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.809790 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.810061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.810869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.812504 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb78c84-7022-44f9-9bd9-d2c6600b1d94 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.823067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1408/2815] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:39.827518 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:39.838509 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f4d8f-8e2c-44f1-bc95-bdf97b23e2b4 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:39.843663 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:39.844517 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.844830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.845110 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] PATH_INFO: `/v3/projects/080ff2e7b94342238c37b5f4f61da92e/users/8ac80128d1304265a358ca160429c8d6/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.860629 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=080ff2e7b94342238c37b5f4f61da92e, user_id=8ac80128d1304265a358ca160429c8d6, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:39.863385 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:39.879895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1408/2816] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:39 2022] PUT /identity/v3/projects/080ff2e7b94342238c37b5f4f61da92e/users/8ac80128d1304265a358ca160429c8d6/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:39.892242 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:39.892535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:39.892847 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:39.920624 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] MFA Rules not processed for user `8ac80128d1304265a358ca160429c8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:39.921886 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:39.994897 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1409/2817] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:40.000371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.068472 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309808fb-ca86-403d-a1fe-2d4408a425ab admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.073880 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.074455 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.074728 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.075035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.075733 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.077757 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.092574 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:40.108147 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1409/2818] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:40.112246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.123082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11c622-0521-413c-b0a2-1b3476bc416a None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.158578 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:40.184325 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.185311 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.185595 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.186207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.186600 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.188543 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.209945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1410/2819] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:40 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:40.213896 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.225552 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc322cf-a643-44c9-995d-935400716eb0 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.231662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.232426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.232808 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.233503 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.234238 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.235871 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.246955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1410/2820] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:40.251876 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.267376 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b592a-30d9-4de4-87a1-248da6ec4140 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.275944 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.277372 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.277695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.278065 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] PATH_INFO: `/v3/projects/4765304abec34c56a136b299884a7485/users/99d9ed0844494d6e8a68908734407987/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.296026 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4765304abec34c56a136b299884a7485, user_id=99d9ed0844494d6e8a68908734407987, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.298778 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.315347 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1411/2821] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:40 2022] PUT /identity/v3/projects/4765304abec34c56a136b299884a7485/users/99d9ed0844494d6e8a68908734407987/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:40.319536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.330223 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8fcee-3c3b-4078-88b7-5c2e4380b714 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.405450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.406153 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.406434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.406712 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.407447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.409200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fcaaaa-1dbc-4cd9-8638-2e8ed1621d7e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.420042 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1411/2822] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 20 15:04:40.424552 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.439437 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b1add-27e0-4fdd-9382-dec3550e5067 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.445529 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.446424 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.446699 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.447014 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] PATH_INFO: `/v3/projects/4765304abec34c56a136b299884a7485/users/99d9ed0844494d6e8a68908734407987/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.449336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4765304abec34c56a136b299884a7485, user_id=99d9ed0844494d6e8a68908734407987, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.452064 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.463531 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1412/2823] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:40 2022] PUT /identity/v3/projects/4765304abec34c56a136b299884a7485/users/99d9ed0844494d6e8a68908734407987/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:40.473986 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.474279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.474559 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.503970 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] MFA Rules not processed for user `99d9ed0844494d6e8a68908734407987`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:40.505241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:40.577772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1412/2824] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:40.589458 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.591296 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:40.653985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1589-7343-4249-a25b-0bbbf51cf6d8 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.658671 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.659307 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.659589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.659852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.669863 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.671630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.681336 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1413/2825] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:40.726205 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:40.727804 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:40.741015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e62a-d92f-4df1-b830-fe72dac7c8e1 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:40.744963 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:40.745608 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:40.745888 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:40.746164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:40.813449 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:40.814905 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f3a75-6776-45d9-ab11-3c036d4cb9d5 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:40.824313 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1413/2826] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:44.228454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:44.335036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:44.347601 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33925b8-c928-4eb5-9d3f-98d1656b93d4 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:44.352532 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:44.353435 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:44.353713 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:44.353983 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] PATH_INFO: `/v3/users/8ac80128d1304265a358ca160429c8d6` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:44.355207 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac80128d1304265a358ca160429c8d6)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:44.357153 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:44.408629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac80128d1304265a358ca160429c8d6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:44.409621 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac80128d1304265a358ca160429c8d6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:44.422736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac80128d1304265a358ca160429c8d6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:44.440477 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac80128d1304265a358ca160429c8d6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:44.441217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac80128d1304265a358ca160429c8d6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:44.453756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1414/2827] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:44 2022] DELETE /identity/v3/users/8ac80128d1304265a358ca160429c8d6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:44.458421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:44.458895 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:44.459069 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:44.464018 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:44.508316 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:44.509577 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:44.573670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1414/2828] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:44.586545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:44.587925 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:44.683358 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38d9b-8f05-4d88-a50a-1deaefcb831c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:44.687474 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:44.688122 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:44.688398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:44.688670 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:44.698935 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:44.700417 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:44.710661 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1415/2829] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:44.999732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:45.001363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:45.016903 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c54ce4-d27b-4787-8a96-a24fee41da68 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:45.022099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:45.023046 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.023329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.023603 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] PATH_INFO: `/v3/projects/080ff2e7b94342238c37b5f4f61da92e` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.024979 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=080ff2e7b94342238c37b5f4f61da92e)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:45.033369 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:45.088796 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '080ff2e7b94342238c37b5f4f61da92e', 'request_id': 'req-c729f165-f3e1-4259-8653-b03bc56314d6'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.095335 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '080ff2e7b94342238c37b5f4f61da92e', 'request_id': 'req-c729f165-f3e1-4259-8653-b03bc56314d6'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.101191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '080ff2e7b94342238c37b5f4f61da92e', 'request_id': 'req-c729f165-f3e1-4259-8653-b03bc56314d6'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.116279 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] The token cache is being invalidate because project 080ff2e7b94342238c37b5f4f61da92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:45.116553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.117277 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.118995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1415/2830] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:44 2022] DELETE /identity/v3/projects/080ff2e7b94342238c37b5f4f61da92e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:45.124690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:45.136032 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300942c-4eac-43fa-a48c-34e2c0114247 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:45.173612 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:45.209130 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:45.210362 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.210727 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.211082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] PATH_INFO: `/v3/users/99d9ed0844494d6e8a68908734407987` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.212630 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d9ed0844494d6e8a68908734407987)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:45.214633 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:45.274288 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d9ed0844494d6e8a68908734407987'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.274953 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d9ed0844494d6e8a68908734407987'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.287544 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d9ed0844494d6e8a68908734407987'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.297179 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d9ed0844494d6e8a68908734407987'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.298015 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-69307240-dff6-4e36-b8b3-ff1277f21cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d9ed0844494d6e8a68908734407987'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.311390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1416/2831] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:45 2022] DELETE /identity/v3/users/99d9ed0844494d6e8a68908734407987 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:45.605636 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:45.607232 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:45.622213 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729f165-f3e1-4259-8653-b03bc56314d6 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:45.683599 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:45.684497 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.684817 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.685093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] PATH_INFO: `/v3/projects/4765304abec34c56a136b299884a7485` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.686304 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4765304abec34c56a136b299884a7485)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:45.688314 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:45.690737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:45.739003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4765304abec34c56a136b299884a7485', 'request_id': 'req-cba0ba48-96d3-4017-b939-a3ad7f877914'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.746294 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4765304abec34c56a136b299884a7485', 'request_id': 'req-cba0ba48-96d3-4017-b939-a3ad7f877914'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.752632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4765304abec34c56a136b299884a7485', 'request_id': 'req-cba0ba48-96d3-4017-b939-a3ad7f877914'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.768411 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] The token cache is being invalidate because project 4765304abec34c56a136b299884a7485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:45.768684 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.769342 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-cba0ba48-96d3-4017-b939-a3ad7f877914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:45.770906 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1416/2832] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:45 2022] DELETE /identity/v3/projects/4765304abec34c56a136b299884a7485 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:45.776229 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.776514 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.776825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.795846 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:45.797235 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:45.869634 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1417/2833] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:45.877847 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.878141 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.878487 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.898499 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:45.899746 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:45.909101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1417/2834] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:45.914982 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:45.926024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654729c-ab09-42eb-bb07-5525ecd8bbb7 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:45.932164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:45.932838 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.933090 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.933368 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.934141 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 15:04:45.934382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:45.935984 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:45.948365 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1418/2835] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 15:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 15:04:45.952932 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:45.963150 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf455f5c-7801-4655-a071-da1beb2fb213 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:45.969759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:45.970409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:45.970694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:45.970965 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:45.971661 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:45.973647 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.003984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1418/2836] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:45 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:46.008239 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.019118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bef5b4-19bd-454a-9cf1-90183a3508a3 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.060236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:46.078684 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.079403 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.079663 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.079929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.080629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.082577 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.105018 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1419/2837] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:46 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:46.109433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.119530 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87870c83-f66f-4b53-bdae-abe287fd216b admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.124076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.124955 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.125096 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.125365 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.126083 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.127673 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.138670 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1419/2838] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:46.142696 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.154466 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8587c0a-5aba-4cff-924a-6e52e4ab0d19 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.160023 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.160693 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.161008 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.161285 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.162024 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.163629 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b9e63-3a91-4870-a62e-60f3f08b4264 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.175279 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1420/2839] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:46.179410 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.190421 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787abbc-a7ce-4872-b12a-7fe8508d4825 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.196354 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.197251 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.197533 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.197807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] PATH_INFO: `/v3/projects/f7b5fd3d437947ff8a358d749dbda28f/users/8e6d8b361fdc47dfbf66a37d28b1144d/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.213648 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b5fd3d437947ff8a358d749dbda28f, user_id=8e6d8b361fdc47dfbf66a37d28b1144d, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.216384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.233178 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1420/2840] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:46 2022] PUT /identity/v3/projects/f7b5fd3d437947ff8a358d749dbda28f/users/8e6d8b361fdc47dfbf66a37d28b1144d/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:46.245367 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.245652 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.245927 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.274860 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] MFA Rules not processed for user `8e6d8b361fdc47dfbf66a37d28b1144d`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:46.276078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:46.345498 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1421/2841] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:46.350164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.416099 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f630fdb-2dda-47ac-9563-1ff8561a3f06 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.421785 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.422443 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.422726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.423035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.423725 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.425702 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.456039 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1421/2842] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:46 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:46.462217 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.475820 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4f525-c010-4805-a4a0-36dc1e3d15cc None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.533356 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.534033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.534314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.534586 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.535280 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.537251 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.558455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1422/2843] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:46 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:46.562562 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.573152 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08162f-3792-4da8-8988-5076b9a99c31 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.578054 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.578713 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.578994 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.579271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.579996 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.581652 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.592386 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1422/2844] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:46.596576 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.607256 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26efea-68d2-48d7-91b7-8ab3dbb7d3b7 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.612680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.613587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.613869 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.614140 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] PATH_INFO: `/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2/users/7e057f47f2794301916573c8690501f6/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.629154 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d7679bb8aa48d09bbd9de21e0a5ea2, user_id=7e057f47f2794301916573c8690501f6, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.631907 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.649603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1423/2845] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:46 2022] PUT /identity/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2/users/7e057f47f2794301916573c8690501f6/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:46.653692 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.659199 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:46.665851 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0c6e7-7dd0-46df-b842-16ae6e9aab79 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.731050 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.731863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.732173 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.732445 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.733485 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.735416 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f30ac4-849c-48fb-a3dc-f6b138280b8a admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.746512 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1423/2846] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:46.751990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.763382 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a78aa-e459-4c78-87f0-f7b99665ce11 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.769530 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.770464 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.770739 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.771011 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] PATH_INFO: `/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2/users/7e057f47f2794301916573c8690501f6/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.773192 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72d7679bb8aa48d09bbd9de21e0a5ea2, user_id=7e057f47f2794301916573c8690501f6, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.775830 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:46.786814 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1424/2847] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:46 2022] PUT /identity/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2/users/7e057f47f2794301916573c8690501f6/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:46.796984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.797317 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.797597 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.825585 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] MFA Rules not processed for user `7e057f47f2794301916573c8690501f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:46.833033 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:46.897515 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1424/2848] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 20 15:04:46.912582 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:46.914695 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:46.920801 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:46.977078 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d710c-8a4c-4f81-876f-b6f7154c7d16 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:46.981690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:46.982264 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:46.982541 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:46.982825 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:46.992745 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:46.994181 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:47.003783 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1425/2849] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:47.115998 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:47.126915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdfee9-9122-457f-bd87-f0507b549691 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:47.131035 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:47.131676 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:47.131962 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:47.132237 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:47.205912 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:47.207390 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92c00f-9982-4858-b014-0fb07fa29461 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:47.217245 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1425/2850] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:49.808364 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:49.873193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec49148-533f-481a-ad35-73bd6f1550e6 service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:49.878409 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:49.879281 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:49.879559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:49.879826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] PATH_INFO: `/v3/users/8e6d8b361fdc47dfbf66a37d28b1144d` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:49.881468 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6d8b361fdc47dfbf66a37d28b1144d)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:49.884033 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:49.938547 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6d8b361fdc47dfbf66a37d28b1144d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:49.939236 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6d8b361fdc47dfbf66a37d28b1144d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:49.952249 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6d8b361fdc47dfbf66a37d28b1144d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:49.962176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6d8b361fdc47dfbf66a37d28b1144d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:49.962995 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6d8b361fdc47dfbf66a37d28b1144d'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:49.975507 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1426/2851] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:49 2022] DELETE /identity/v3/users/8e6d8b361fdc47dfbf66a37d28b1144d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:49.980243 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:49.980782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:49.980782 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:49.999056 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:50.000434 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:50.021117 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=100 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:50.067626 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1426/2852] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:50.077557 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:50.079069 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:50.108193 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:50.140271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e17cc2-91a9-41e2-8820-abed6bdd11db admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:50.144850 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:50.145500 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:50.145777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:50.146044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:50.156250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:50.158785 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:50.168481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1427/2853] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:50.443013 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:50.444666 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:50.457429 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b48ca-c5d7-4b6e-8559-55ab459c3f57 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:50.464389 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:50.465402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:50.465745 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:50.466084 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] PATH_INFO: `/v3/projects/f7b5fd3d437947ff8a358d749dbda28f` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:50.467454 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b5fd3d437947ff8a358d749dbda28f)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:50.469595 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:50.523617 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b5fd3d437947ff8a358d749dbda28f', 'request_id': 'req-34310713-d836-4628-ba93-ffe3833c03be'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.530103 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b5fd3d437947ff8a358d749dbda28f', 'request_id': 'req-34310713-d836-4628-ba93-ffe3833c03be'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.536764 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b5fd3d437947ff8a358d749dbda28f', 'request_id': 'req-34310713-d836-4628-ba93-ffe3833c03be'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.553188 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] The token cache is being invalidate because project f7b5fd3d437947ff8a358d749dbda28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:50.553474 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.554111 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.555743 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1427/2854] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:50 2022] DELETE /identity/v3/projects/f7b5fd3d437947ff8a358d749dbda28f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:50.560247 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:50.570604 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500f12-9e2f-47a0-863d-0776885ee066 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:50.629246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:50.630118 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:50.630398 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:50.630672 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] PATH_INFO: `/v3/users/7e057f47f2794301916573c8690501f6` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:50.631896 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e057f47f2794301916573c8690501f6)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:50.633864 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:50.688516 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e057f47f2794301916573c8690501f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.689081 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e057f47f2794301916573c8690501f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.700937 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e057f47f2794301916573c8690501f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.711386 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e057f47f2794301916573c8690501f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.712044 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-14b9e4c1-eae5-48fe-b48e-1a4f1c4989a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e057f47f2794301916573c8690501f6'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:50.724962 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1428/2855] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:04:50 2022] DELETE /identity/v3/users/7e057f47f2794301916573c8690501f6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:51.017977 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.019993 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:51.038541 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34310713-d836-4628-ba93-ffe3833c03be admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.098020 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.098803 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.099061 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.099363 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] PATH_INFO: `/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.100565 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72d7679bb8aa48d09bbd9de21e0a5ea2)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.102522 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.161163 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:51.162444 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72d7679bb8aa48d09bbd9de21e0a5ea2', 'request_id': 'req-a202a295-2e35-4818-b5d4-11c6e157b9a5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:51.173101 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72d7679bb8aa48d09bbd9de21e0a5ea2', 'request_id': 'req-a202a295-2e35-4818-b5d4-11c6e157b9a5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:51.180008 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72d7679bb8aa48d09bbd9de21e0a5ea2', 'request_id': 'req-a202a295-2e35-4818-b5d4-11c6e157b9a5'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:51.195893 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] The token cache is being invalidate because project 72d7679bb8aa48d09bbd9de21e0a5ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:04:51.196211 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:51.196910 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-a202a295-2e35-4818-b5d4-11c6e157b9a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:04:51.198557 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1428/2856] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:04:51 2022] DELETE /identity/v3/projects/72d7679bb8aa48d09bbd9de21e0a5ea2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:51.203659 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.204155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.204272 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.223159 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:51.224380 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:51.272075 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:51.291108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1429/2857] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:51.299291 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.299546 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.299818 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.319863 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:51.321122 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:51.330504 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1429/2858] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:51.334875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.345241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aac034-abb1-4e44-a29a-7521e3525929 None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.350579 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.351169 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.351452 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.351726 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.352455 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 15:04:51.352749 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.354389 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.368243 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1430/2859] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 15:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 15:04:51.373183 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.385093 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3bc72-8d2e-4943-aa65-ab9104384c44 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.392298 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.392969 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.393247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.393513 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.394207 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.396168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.425714 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1430/2860] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:51.430004 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.440682 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a08c8a-7c58-40b8-bfff-f93fc7545559 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.503559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.504237 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.504519 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.504811 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.505515 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.507471 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.530492 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1431/2861] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:51.535031 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.547715 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e05b-e02a-4fe4-8d06-5698177580e1 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.556305 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.557655 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.558007 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.558271 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.559391 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.561737 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.573520 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1431/2862] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:51.577756 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.588545 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a9079-9ef5-477e-80f4-7e9883da79fb admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.593521 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.594335 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.594675 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.594952 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.595680 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.597314 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc395779-e944-4ed2-8741-3c8faa2f61ec admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.607610 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1432/2863] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:51.612047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.622235 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b6214-ebd5-424f-9a4c-cab27bf1ad23 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.627264 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.628137 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.628417 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.628839 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] PATH_INFO: `/v3/projects/38e4843aec634294b821fffffab95025/users/f530f9ab11374e00957e573b0f9796bd/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.644600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e4843aec634294b821fffffab95025, user_id=f530f9ab11374e00957e573b0f9796bd, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.648168 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.665403 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1432/2864] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:51 2022] PUT /identity/v3/projects/38e4843aec634294b821fffffab95025/users/f530f9ab11374e00957e573b0f9796bd/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 20 15:04:51.731451 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.731871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.732218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.762182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] MFA Rules not processed for user `f530f9ab11374e00957e573b0f9796bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:51.763429 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:51.827750 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1433/2865] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:51.832732 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.899717 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7df51e-413b-4ff2-adfb-6f1c87744007 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.904409 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:51.905224 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:51.905514 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:51.905791 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:51.906502 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:51.908601 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:51.937047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1433/2866] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:51.942117 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:51.956535 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c5b3e-fdb5-45c2-b9bc-3c5093390d7d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:51.998558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:52.017045 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.017733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.018013 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.018286 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.018992 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.020985 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.047871 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1434/2867] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:04:51 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:04:52.051956 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:52.063017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e1d6b-724c-48ac-b41c-c910df96d995 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:52.068468 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.069164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.069447 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.069723 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.070451 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.072109 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.083017 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1434/2868] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:52.087444 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:52.098250 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313394fa-d08c-4e62-a2c3-c1bfeb24626c admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:52.104405 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.105330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.105614 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.105890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] PATH_INFO: `/v3/projects/ef35e8e636ad41e89d0e294be63c6af2/users/c24be20c7c4a42198bfdeee6b9ced110/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.121176 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35e8e636ad41e89d0e294be63c6af2, user_id=c24be20c7c4a42198bfdeee6b9ced110, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.123826 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.141061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1435/2869] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:52 2022] PUT /identity/v3/projects/ef35e8e636ad41e89d0e294be63c6af2/users/c24be20c7c4a42198bfdeee6b9ced110/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:52.145060 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:52.156766 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d88b60-1754-47af-b4fb-ab6599994fac admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:52.203344 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:04:52.218694 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.219639 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.219798 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.220073 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.220837 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.222484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af213da-0c0b-46c1-b755-83f8ee16b54b admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.232649 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1435/2870] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:04:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:04:52.236972 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:52.247360 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd802eae-2a5d-4a1e-bf9a-28cf8c7457ea admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:52.252772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.253744 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] REQUEST_METHOD: `PUT` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.254091 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.254427 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] PATH_INFO: `/v3/projects/ef35e8e636ad41e89d0e294be63c6af2/users/c24be20c7c4a42198bfdeee6b9ced110/roles/695e03655fc54138a800137878e15659` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.256503 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef35e8e636ad41e89d0e294be63c6af2, user_id=c24be20c7c4a42198bfdeee6b9ced110, role_id=695e03655fc54138a800137878e15659)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.259263 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.270061 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1436/2871] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:04:52 2022] PUT /identity/v3/projects/ef35e8e636ad41e89d0e294be63c6af2/users/c24be20c7c4a42198bfdeee6b9ced110/roles/695e03655fc54138a800137878e15659 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:04:52.280286 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.280580 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.280914 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.307761 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] MFA Rules not processed for user `c24be20c7c4a42198bfdeee6b9ced110`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:04:52.309011 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:52.379453 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1436/2872] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:04:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:04:52.390299 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:52.392788 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:52.454413 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bd13f-be8c-441d-81f2-99a976337884 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:52.458305 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:52.458945 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:52.459223 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:52.459491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:52.523105 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:52.524590 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:52.534147 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1437/2873] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:04:56.788172 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:04:56.789825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:04:56.803180 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff47ff-83fc-4d00-af18-ff6db4b22264 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:04:56.807971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:04:56.808606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:04:56.808925 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:04:56.809200 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:04:56.818995 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:04:56.820491 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caffb98-9e3b-44d5-b8dc-8151ca1a2623 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:04:56.830825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1437/2874] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:04:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:01.765736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:01.822707 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:01.839043 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4370022-e1d3-4c25-b83b-6c4f530a1a7f service cinder] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:01.844238 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:01.845142 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:01.845423 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:01.845697 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] PATH_INFO: `/v3/users/f530f9ab11374e00957e573b0f9796bd` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:01.846951 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f530f9ab11374e00957e573b0f9796bd)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:01.848910 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:01.901558 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f530f9ab11374e00957e573b0f9796bd'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:01.902220 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f530f9ab11374e00957e573b0f9796bd'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:01.913852 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f530f9ab11374e00957e573b0f9796bd'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:01.923481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f530f9ab11374e00957e573b0f9796bd'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:01.924107 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f530f9ab11374e00957e573b0f9796bd'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:01.937481 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1438/2875] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:05:01 2022] DELETE /identity/v3/users/f530f9ab11374e00957e573b0f9796bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:05:01.942234 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:01.942772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:01.942772 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:01.965632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:01.966861 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:02.030984 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1438/2876] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:02.041366 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:02.043038 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:02.105875 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cf886-23ee-4dd1-91dd-255e20c86ce6 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:02.112271 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:02.113212 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:02.113568 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:02.113977 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:02.123989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:02.125540 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:02.135832 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1439/2877] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:02.423489 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:02.425063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:02.441402 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeea8fb-f777-4cfd-9f13-bd6c26a5f779 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:02.448250 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:02.449161 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:02.449440 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:02.449711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] PATH_INFO: `/v3/projects/38e4843aec634294b821fffffab95025` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:02.450931 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e4843aec634294b821fffffab95025)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:02.453068 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:02.503645 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e4843aec634294b821fffffab95025', 'request_id': 'req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.504790 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:02.512961 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e4843aec634294b821fffffab95025', 'request_id': 'req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.519087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e4843aec634294b821fffffab95025', 'request_id': 'req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.534072 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] The token cache is being invalidate because project 38e4843aec634294b821fffffab95025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:05:02.534296 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.534991 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.536653 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1439/2878] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:05:02 2022] DELETE /identity/v3/projects/38e4843aec634294b821fffffab95025 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:05:02.540990 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:02.551036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545314a-c6ee-449b-a91f-93c8864cdb12 service neutron] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:02.609571 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:02.610440 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:02.610717 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:02.610987 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] PATH_INFO: `/v3/users/c24be20c7c4a42198bfdeee6b9ced110` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:02.612216 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24be20c7c4a42198bfdeee6b9ced110)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:02.614332 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:02.626913 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:02.668434 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24be20c7c4a42198bfdeee6b9ced110'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.669246 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24be20c7c4a42198bfdeee6b9ced110'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.682781 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24be20c7c4a42198bfdeee6b9ced110'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.693375 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24be20c7c4a42198bfdeee6b9ced110'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.694163 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-9944d32c-f0ec-488e-a158-b93beebe9662 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24be20c7c4a42198bfdeee6b9ced110'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:02.707050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1440/2879] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:05:02 2022] DELETE /identity/v3/users/c24be20c7c4a42198bfdeee6b9ced110 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:05:02.986902 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:02.988332 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:03.001701 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863e2a0-38b7-4cd2-b694-b9ef74ae5028 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.067322 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.068148 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.068536 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.068915 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] PATH_INFO: `/v3/projects/ef35e8e636ad41e89d0e294be63c6af2` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.070935 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef35e8e636ad41e89d0e294be63c6af2)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.073819 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.135525 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef35e8e636ad41e89d0e294be63c6af2', 'request_id': 'req-15d9c689-1c27-4b5b-b859-490446f0bc9e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:03.142169 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef35e8e636ad41e89d0e294be63c6af2', 'request_id': 'req-15d9c689-1c27-4b5b-b859-490446f0bc9e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:03.149140 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef35e8e636ad41e89d0e294be63c6af2', 'request_id': 'req-15d9c689-1c27-4b5b-b859-490446f0bc9e'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:03.164015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] The token cache is being invalidate because project ef35e8e636ad41e89d0e294be63c6af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:05:03.164308 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:03.167945 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-15d9c689-1c27-4b5b-b859-490446f0bc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:05:03.170079 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1440/2880] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:05:02 2022] DELETE /identity/v3/projects/ef35e8e636ad41e89d0e294be63c6af2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:05:03.176219 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.176690 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.176828 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.196932 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:03.198155 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:03.265917 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1441/2881] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:03.275726 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.276012 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.276285 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.296465 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:03.297711 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:03.313742 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1441/2882] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:03.318795 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.330603 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40fbb4-a156-4390-afdf-2e9e96d13c3d None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.336829 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.337491 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.337772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.338046 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] PATH_INFO: `/v3/domains` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.338799 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 20 15:05:03.339103 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.340703 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.353589 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1442/2883] 10.222.0.23 () {58 vars in 1152 bytes} [Mon Jun 20 15:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 20 15:05:03.358055 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.368003 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaca95-8495-4464-b483-0f649e5576e4 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.373759 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.374437 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.374720 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.374997 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] PATH_INFO: `/v3/projects` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.375688 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.377662 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.406854 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1442/2884] 10.222.0.23 () {60 vars in 1152 bytes} [Mon Jun 20 15:05:03 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:05:03.410929 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.421551 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9e82c-67f7-4b7f-bbc6-d240b1156975 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.481677 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.482340 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.482637 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.482909 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] PATH_INFO: `/v3/users` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.483585 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.485548 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.505989 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1443/2885] 10.222.0.23 () {60 vars in 1143 bytes} [Mon Jun 20 15:05:03 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 20 15:05:03.510450 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.520699 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd454b63-05c4-4565-8b10-483df83d8753 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.525615 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.526269 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.526553 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.526825 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.527549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.529193 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.545351 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1443/2886] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:05:03.547074 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.558164 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0331d9-8d13-4036-b847-b896a0ffaacc admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.563082 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.563736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.564016 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.564291 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] PATH_INFO: `/v3/roles` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.565053 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.566644 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862f887-fabe-4589-9081-25af9a1df060 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.568190 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:03.579654 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1444/2887] 10.222.0.23 () {58 vars in 1121 bytes} [Mon Jun 20 15:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 20 15:05:03.583632 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.594015 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aedf24-40e2-49ae-87d8-48fc5f7c70c3 admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.599531 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.600442 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.600741 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.601029 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] PATH_INFO: `/v3/projects/655fee4df800492ca9507af988943721/users/2365819f6b8d4c0e83db04d90e710969/roles/75014435b442408ea67a373f2483e12c` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.616852 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=655fee4df800492ca9507af988943721, user_id=2365819f6b8d4c0e83db04d90e710969, role_id=75014435b442408ea67a373f2483e12c)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.619809 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.634971 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1444/2888] 10.222.0.23 () {60 vars in 1482 bytes} [Mon Jun 20 15:05:03 2022] PUT /identity/v3/projects/655fee4df800492ca9507af988943721/users/2365819f6b8d4c0e83db04d90e710969/roles/75014435b442408ea67a373f2483e12c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:05:03.642689 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63342-cff6-430d-8006-6497e7ba9c38 None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.643012 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63342-cff6-430d-8006-6497e7ba9c38 None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.643378 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d63342-cff6-430d-8006-6497e7ba9c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.662412 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-f5d63342-cff6-430d-8006-6497e7ba9c38 None None] MFA Rules not processed for user `b3edecff66d3402591d4ea9f1c0735a7`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:03.663608 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f5d63342-cff6-430d-8006-6497e7ba9c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:03.725399 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1445/2889] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:03.737047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:03.738985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:03.746273 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:03.808215 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5902615-ac45-4f65-8e1e-53f27f1d5ecd admin admin] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:03.812252 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:03.812936 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:03.813206 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:03.813477 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:03.823076 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:03.824532 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:03.834329 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1445/2890] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:04.466182 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1cb-a418-44ac-a705-f15a3ea052bc None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:04.466700 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1cb-a418-44ac-a705-f15a3ea052bc None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:04.466817 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2c1cb-a418-44ac-a705-f15a3ea052bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:04.493241 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-1ce2c1cb-a418-44ac-a705-f15a3ea052bc None None] MFA Rules not processed for user `2365819f6b8d4c0e83db04d90e710969`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:04.494559 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-1ce2c1cb-a418-44ac-a705-f15a3ea052bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:04.567584 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1446/2891] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:04.579744 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:04.581371 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:04.644063 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881138a-7e38-426d-8106-214decbd0006 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:04.647830 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e17921df6504f73b8a743b477924590', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:04.648481 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:04.648792 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:04.649129 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:04.658357 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:04.659810 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:04.669143 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1446/2892] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:06.044253 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] REQUEST_METHOD: `POST` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:06.044779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:06.044779 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:06.063759 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.auth.core [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] MFA Rules not processed for user `2365819f6b8d4c0e83db04d90e710969`. Rule list: `[]` (Enabled: `True`). {{(pid=86686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:05:06.065000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:06.072969 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1447/2893] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:05:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:05:06.322381 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:06.332677 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f36f0-9019-497e-ace9-34dba0328b24 service cinder] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:06.337114 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b6e8b195e224b68bc4d5bc0c04db9dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:06.337807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:06.338087 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:06.338361 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:06.340549 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:06.350938 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:06.352584 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:06.361106 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1447/2894] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:06.690890 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:06.692331 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:06.770022 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e01d0-bbd1-4b08-85aa-063748aea2df None None] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:06.776063 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:06.776747 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:06.777027 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:06.777300 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:06.779211 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:06.791108 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:06.792733 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:06.803649 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1448/2895] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:14.267426 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:14.269241 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:14.347387 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1559a0b-17b5-4110-a031-f3daecebc0b6 service neutron] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:14.353338 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '644364ac21704f9281845a8af6fa0b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:14.353985 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] REQUEST_METHOD: `GET` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:14.354262 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:14.354529 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:14.356646 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:14.369319 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:14.370926 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece52c5-5656-4551-b5f4-4fa7feb8af27 service nova] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:14.381795 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1448/2896] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:14.787289 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:05:14.812005 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=100 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:14.822390 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb115c0-bec1-492a-9289-501f122a2e19 service placement] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:05:14.830484 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:05:14.831254 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:05:14.832000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:05:14.832000 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:05:14.834003 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:05:14.859702 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:05:14.861402 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:05:14.871676 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1449/2897] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:05:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:05:24.377247 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=90 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:05:24.867215 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=11 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:03.285047 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] REQUEST_METHOD: `POST` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:06:03.285600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:06:03.285600 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:06:03.304484 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.auth.core [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] MFA Rules not processed for user `2365819f6b8d4c0e83db04d90e710969`. Rule list: `[]` (Enabled: `True`). {{(pid=86687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 20 15:06:03.305748 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.fernet_utils [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:06:03.313850 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1449/2898] 10.222.0.23 () {58 vars in 957 bytes} [Mon Jun 20 15:06:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 20 15:06:13.299191 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=3 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:06:58.159954 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:06:58.171036 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f83a-290c-4748-bd5c-16fa1389d3d2 service placement] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:06:58.177173 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:06:58.178067 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:06:58.178343 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:06:58.178613 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] PATH_INFO: `/v3/users/2365819f6b8d4c0e83db04d90e710969` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:06:58.179924 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2365819f6b8d4c0e83db04d90e710969)` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:06:58.182218 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:06:58.235711 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2365819f6b8d4c0e83db04d90e710969'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.236290 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2365819f6b8d4c0e83db04d90e710969'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.248092 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2365819f6b8d4c0e83db04d90e710969'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.257050 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2365819f6b8d4c0e83db04d90e710969'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.257736 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.notifications [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2365819f6b8d4c0e83db04d90e710969'} {{(pid=86686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.271353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1450/2899] 10.222.0.23 () {58 vars in 1223 bytes} [Mon Jun 20 15:06:58 2022] DELETE /identity/v3/users/2365819f6b8d4c0e83db04d90e710969 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:06:58.471770 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] Authenticating user token {{(pid=86687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:06:58.483175 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdebcd-e68e-4cec-b31e-ec33a58e1fc6 None None] Validating token access rules against request {{(pid=86687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:06:58.548704 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3edecff66d3402591d4ea9f1c0735a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '995754b005f44c748381f029d2a25afd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:06:58.549606 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:06:58.549889 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:06:58.550164 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] PATH_INFO: `/v3/projects/655fee4df800492ca9507af988943721` {{(pid=86687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:06:58.551382 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655fee4df800492ca9507af988943721)` {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:06:58.553384 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] RBAC: Authorization granted {{(pid=86687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:06:58.601004 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655fee4df800492ca9507af988943721', 'request_id': 'req-eddc3c84-d43e-424a-9188-5db6464e8158'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.607156 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655fee4df800492ca9507af988943721', 'request_id': 'req-eddc3c84-d43e-424a-9188-5db6464e8158'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.613233 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655fee4df800492ca9507af988943721', 'request_id': 'req-eddc3c84-d43e-424a-9188-5db6464e8158'} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.627521 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] The token cache is being invalidate because project 655fee4df800492ca9507af988943721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 20 15:06:58.627807 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.628433 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG keystone.notifications [None req-eddc3c84-d43e-424a-9188-5db6464e8158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 20 15:06:58.630045 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: [pid: 86687|app: 0|req: 1450/2900] 10.222.0.23 () {58 vars in 1232 bytes} [Mon Jun 20 15:06:58 2022] DELETE /identity/v3/projects/655fee4df800492ca9507af988943721 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 20 15:07:08.267772 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:07:08.624591 dv-cinder-836973-5-iscsi devstack@keystone.service[86687]: DEBUG dbcounter [-] [86687] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 15:10:19.529330 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Authenticating user token {{(pid=86686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 20 15:10:19.531184 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:10:19.607587 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c840d4-eb29-4ef2-beb3-376c385e2654 admin admin] Validating token access rules against request {{(pid=86686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 20 15:10:19.672353 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a352ef3c0df4e4ea94f3a76b96abb87', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80dfb8b8c228411ab455ca5f6024a298', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 20 15:10:19.673040 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] REQUEST_METHOD: `GET` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 20 15:10:19.673327 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] SCRIPT_NAME: `/identity` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 20 15:10:19.673588 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 20 15:10:19.675657 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.fernet_utils [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 20 15:10:19.687777 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 20 15:10:19.689404 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b84083-c308-4cf1-8696-ecf6b5834ee3 service placement] RBAC: Authorization granted {{(pid=86686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 20 15:10:19.700454 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: [pid: 86686|app: 0|req: 1451/2901] 10.222.0.23 () {60 vars in 1365 bytes} [Mon Jun 20 15:10:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 20 15:10:29.696007 dv-cinder-836973-5-iscsi devstack@keystone.service[86686]: DEBUG dbcounter [-] [86686] Writing DB stats keystone:SELECT=58 {{(pid=86686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}